Oct 30 14:03:59.341321 ip-10-0-132-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 14:03:59.341334 ip-10-0-132-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 14:03:59.341344 ip-10-0-132-7 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 14:03:59.341676 ip-10-0-132-7 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 14:04:09.590130 ip-10-0-132-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 14:04:09.590150 ip-10-0-132-7 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 31668288efd14b6e82855164eb40513b --
Oct 30 14:06:05.368566 ip-10-0-132-7 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 14:06:05.801951 ip-10-0-132-7 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 14:06:05.801951 ip-10-0-132-7 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 14:06:05.801951 ip-10-0-132-7 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 14:06:05.801951 ip-10-0-132-7 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 14:06:05.805300 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805207    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.805300 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805300    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805304    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805308    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805311    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805314    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805316    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805319    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805322    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805328    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805331    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805334    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805338    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805341    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805344    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805347    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805349    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805352    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805355    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805358    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.805370 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805360    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805363    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805365    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805370    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805374    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805378    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805381    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805384    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805387    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805390    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805392    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805395    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805398    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805401    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805403    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805406    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805408    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805411    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805413    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.805810 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805417    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805419    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805422    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805425    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805427    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805430    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805432    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805435    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805437    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805440    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805442    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805445    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805447    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805450    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805453    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805456    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805459    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805461    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805464    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805467    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805469    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.806262 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805472    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805474    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805477    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805480    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805482    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805485    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805487    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805492    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805496    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805498    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805501    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805504    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805507    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805509    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805512    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805516    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805518    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805521    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805524    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.806759 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805526    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805529    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805532    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805534    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805537    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805540    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805543    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805546    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805549    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805551    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805554    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805557    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805559    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805562    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805564    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805568    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805570    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805573    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805576    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805578    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.807198 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805581    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805583    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805586    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805588    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805591    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805593    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.805596    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806433    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806440    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806443    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806446    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806450    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806453    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806456    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806459    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806461    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806465    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806469    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806473    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.807726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806476    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806478    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806481    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806484    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806486    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806489    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806492    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806495    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806498    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806500    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806503    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806506    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806508    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806510    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806514    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806516    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806519    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806522    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806525    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806528    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.808192 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806531    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806534    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806537    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806539    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806542    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806545    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806547    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806550    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806554    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806557    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806560    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806563    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806566    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806569    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806571    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806574    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806576    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806579    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806582    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806584    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.808680 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806587    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806590    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806592    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806595    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806598    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806600    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806603    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806606    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806608    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806611    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806613    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806616    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806619    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806622    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806625    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806627    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806630    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806632    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806635    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806637    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.809147 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806640    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806642    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806645    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806648    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806651    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806654    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806657    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806660    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806663    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806666    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806668    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806671    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806674    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806676    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806679    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806681    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806684    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806687    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806689    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.809628 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806692    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806695    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806697    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806700    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806703    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806705    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806708    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806710    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806715    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806719    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806721    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806724    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806727    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806730    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.806732    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807213    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807218    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807221    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807224    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.810073 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807227    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807230    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807233    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807236    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807239    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807242    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807258    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807261    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807263    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807266    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807269    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807271    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807274    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807276    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807280    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807284    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807287    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807289    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807292    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.810548 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807295    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807298    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807301    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807303    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807306    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807309    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807311    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807314    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807317    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807319    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807322    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807324    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807327    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807330    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807332    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807335    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807338    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807341    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807343    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807346    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.810996 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807349    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807351    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807354    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807357    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807359    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807362    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807364    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807367    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807369    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807372    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807374    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807377    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807380    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807383    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807386    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807389    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807391    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807394    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807396    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807399    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.811490 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807401    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807404    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807406    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807409    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807416    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807419    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807421    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807424    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807426    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807429    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807431    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807434    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807437    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807440    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807442    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807445    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807447    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807450    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807452    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.811961 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807455    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807457    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807460    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807462    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807465    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807468    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807470    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807473    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807478    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807480    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807483    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807486    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807489    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807491    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807493    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807496    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807498    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807503    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807505    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.812442 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807510    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807514    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807517    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807520    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.807523    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808188    2580 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808198    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808205    2580 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808210    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808214    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808218    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808222    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808226    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808230    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808233    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808236    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808240    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808255    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808259    2580 flags.go:64] FLAG: --cgroup-root=""
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808262    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808265    2580 flags.go:64] FLAG: --client-ca-file=""
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808268    2580 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808272    2580 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 14:06:05.812885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808277    2580 flags.go:64] FLAG: --cluster-domain=""
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808280    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808283    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808287    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808290    2580 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808294    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808297    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808301    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808305    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808308    2580 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808311    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808314    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808317    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808320    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808325    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808328    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808331    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808333    2580 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808336    2580 flags.go:64] FLAG: --enable-server="true"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808339    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808344    2580 flags.go:64] FLAG: --event-burst="100"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808347    2580 flags.go:64] FLAG: --event-qps="50"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808350    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808353    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 14:06:05.813428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808357    2580 flags.go:64] FLAG: --eviction-hard=""
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808361    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808365    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808368    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808371    2580 flags.go:64] FLAG: --eviction-soft=""
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808374    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808378    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808381    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808385    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808388    2580 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808391    2580 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808394    2580 flags.go:64] FLAG: --feature-gates=""
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808399    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808402    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808405    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808408    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808411    2580 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808414    2580 flags.go:64] FLAG: --help="false"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808417    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808421    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808424    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808427    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808430    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 14:06:05.814011 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808433    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808436    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808439    2580 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808442    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808445    2580 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808448    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808451    2580 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808454    2580 flags.go:64] FLAG: --kube-reserved=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808457    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808460    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808463    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808466    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808469    2580 flags.go:64] FLAG: --lock-file=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808473    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808476    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808479    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808485    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808488    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808491    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808494    2580 flags.go:64] FLAG: --logging-format="text"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808497    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808501    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808504    2580 flags.go:64] FLAG: --manifest-url=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808507    2580 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808512    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 14:06:05.814570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808515    2580 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808519    2580 flags.go:64] FLAG: --max-pods="110"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808522    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808525    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808528    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808531    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808534    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808537    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808540    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808547    2580 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808550    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808553    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808556    2580 flags.go:64] FLAG: --pod-cidr=""
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808559    2580 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808562    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808565    2580 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808568    2580 flags.go:64] FLAG: --port="10250"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808571    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808574    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2d6e251c50af9dc"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808578    2580 flags.go:64] FLAG: --qos-reserved=""
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808581    2580 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808584    2580 flags.go:64] FLAG: --register-node="true"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808587    2580 flags.go:64] FLAG: --register-with-taints=""
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808594    2580 flags.go:64] FLAG: --registry-burst="10"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808597    2580 flags.go:64] FLAG: --registry-qps="5"
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808600    2580 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 14:06:05.815151 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808603    2580 flags.go:64] FLAG: --reserved-memory=""
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808607    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808611    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808614    2580 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808617    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808620    2580 flags.go:64] FLAG: --runonce="false"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808623    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808626    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808629    2580 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808632    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808635    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808638    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808641    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808644    2580 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808647    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808650    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808653    2580 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808656    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808659    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808662    2580 flags.go:64] FLAG: --system-cgroups=""
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808665    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808670    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808673    2580 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808679    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808684    2580 flags.go:64] FLAG: --tls-min-version=""
Oct 30 14:06:05.815840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808688    2580 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808691    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808694    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808697    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808700    2580 flags.go:64] FLAG: --v="2"
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808704    2580 flags.go:64] FLAG: --version="false"
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808709    2580 flags.go:64] FLAG: --vmodule=""
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808713    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.808717    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808877    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808881    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808886    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808889    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808893    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808896    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808898    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808901    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808904    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808906    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808909    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808912    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.816428 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808914    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808917    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808920    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808922    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808925    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808928    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808930    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808933    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808935    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808941    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808943    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808946    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808949    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808951    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808954    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808957    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808959    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808962    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808965    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808967    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.816923 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808970    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808973    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808976    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808979    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808981    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808984    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808986    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808989    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808992    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808994    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808997    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.808999    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809002    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809004    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809007    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809009    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809012    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809014    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809017    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809020    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.817415 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809022    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809027    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809030    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809033    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809036    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809038    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809041    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809043    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809046    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809049    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809051    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809054    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809056    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809059    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809062    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809065    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809067    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809070    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809072    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809075    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.818205 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809077    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809080    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809083    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809085    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809088    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809090    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809093    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809095    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809098    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809101    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809103    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809106    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809108    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809113    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809116    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809119    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809122    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809124    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809127    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809129    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.818985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809132    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809134    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809137    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809139    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809142    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809144    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809148    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809150    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809153    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809156    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809159    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809161    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809164    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809168    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.809193    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 14:06:05.819491 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809229    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809234    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809237    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809240    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809254    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809257    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809259    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809262    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809265    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809267    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809271    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809275    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809277    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809280    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809283    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809285    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809288    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809291    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809293    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.819843 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809296    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809298    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809301    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809304    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809306    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809309    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809312    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809315    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809318    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809321    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809323    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809326    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809328    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809331    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809334    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809337    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809339    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809342    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809344    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809347    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.820477 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809350    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809352    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809355    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809359    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809362    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809367    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809369    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809372    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809375    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809377    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809380    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809383    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809387    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809390    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809393    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809397    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809400    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809403    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809406    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.820933 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809409    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809412    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809414    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809417    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809419    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809422    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809425    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809427    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809430    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809432    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809435    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809438    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809440    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809443    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809445    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809448    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809452    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809456    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809459    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809462    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.821410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809464    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809467    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809470    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809472    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809475    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809478    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809480    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809483    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809486    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809488    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809491    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809494    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809497    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809499    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809502    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809504    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809507    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809509    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809512    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809514    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.821898 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809517    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809520    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809522    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809525    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809527    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809530    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809533    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.809536    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.816037    2580 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.816052    2580 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.816063    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.816068    2580 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816126    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816131    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816134    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816138    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816141    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816144    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816147    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816150    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.822378 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816153    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816156    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816158    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816161    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816163    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816166    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816169    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816171    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816174    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816177    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816181    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816185    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816188    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816191    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816193    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816196    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816199    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816202    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816205    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.822842 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816208    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816210    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816214    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816217    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816220    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816222    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816225    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816228    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816230    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816233    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816235    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816238    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816241    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816256    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816259    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816262    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816265    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816267    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816270    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.823318 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816273    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816276    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816278    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816281    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816283    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816286    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816288    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816291    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816294    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816296    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816299    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816301    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816304    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816308    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816311    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816313    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816316    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816319    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816322    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816325    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.823753 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816328    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816330    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816333    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816335    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816338    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816340    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816343    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816346    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816348    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816351    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816353    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816356    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816359    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816361    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816364    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816366    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816369    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816372    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816375    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.824215 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816377    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816380    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816384    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816387    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816390    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816393    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816396    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816398    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816401    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816403    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816406    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816409    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816412    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816414    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816417    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816419    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816422    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816424    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816427    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816429    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.824670 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816432    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.816459    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816617    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816622    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816625    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816628    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816630    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816633    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816635    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816638    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816641    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816644    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816647    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816649    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816652    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816654    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.825135 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816657    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816659    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816662    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816665    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816668    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816670    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816673    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816676    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816679    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816682    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816685    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816687    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816690    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816692    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816695    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816698    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816700    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816702    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816705    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816708    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.825526 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816710    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816713    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816715    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816718    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816720    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816723    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816725    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816728    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816730    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816733    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816735    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816740    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816743    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816746    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816749    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816752    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816755    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816757    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816760    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.825988 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816762    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816766    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816769    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816771    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816774    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816777    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816779    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816782    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816784    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816787    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816789    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816791    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816794    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816797    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816800    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816803    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816807    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816810    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816814    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.826444 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816817    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816819    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816822    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816825    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816827    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816830    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816832    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816835    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816837    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816840    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816842    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816845    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816847    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816850    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816852    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816855    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816858    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816861    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816863    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816866    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.826889 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816868    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816871    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816873    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816876    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816878    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816881    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816884    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816886    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816889    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816894    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816897    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816899    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816902    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816905    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.816927    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816958    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:05.827422 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816962    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816965    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816967    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816970    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816973    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816975    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816978    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816980    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816982    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816985    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816988    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816990    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816994    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.816997    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817000    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817002    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817005    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817007    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817010    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817012    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:05.827804 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817015    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817018    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817020    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817023    2580 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817025    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817029    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817031    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817034    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817036    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817039    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817041    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817044    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817046    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817048    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817051    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817053    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817056    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817058    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817061    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817063    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:05.828435 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817066    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817069    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817071    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817074    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817076    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817079    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817082    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817085    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817088    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817092    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817095    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817098    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817101    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817104    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817106    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817108    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817111    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817114    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817116    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:05.828931 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817118    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817121    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817124    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817127    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817129    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817132    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817134    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817137    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817139    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817142    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817144    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817146    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817149    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817153    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817156    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817159    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817162    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817164    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817167    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:05.829410 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817170    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817173    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817175    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817178    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817180    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817183    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817185    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817188    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817190    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817193    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817195    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817198    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817200    2580 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817203    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817206    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817208    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817210    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817213    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817216    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:05.829881 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817219    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817221    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817224    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817226    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817229    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817231    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817234    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:05.817236    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.817309    2580 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.822787    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.823751    2580 server.go:1014] "Starting client certificate rotation"
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.823841    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.823882    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.825975    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 14:06:05.830331 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.827165    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 14:06:05.838479 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.838461    2580 log.go:25] "Validated CRI v1 runtime API"
Oct 30 14:06:05.841791 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.841774    2580 log.go:25] "Validated CRI v1 image API"
Oct 30 14:06:05.842597 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.842574    2580 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 14:06:05.845259 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.845213    2580 fs.go:135] Filesystem UUIDs: map[12963897-6158-4556-9965-972a993d3e6c:/dev/nvme0n1p4 30bf16de-95ac-4d79-9cb8-4d54f51780dc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 14:06:05.845346 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.845242    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 14:06:05.851386 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.851266    2580 manager.go:217] Machine: {Timestamp:2026-10-30 14:06:05.849783943 +0000 UTC m=+0.356244697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101076 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28d26195da4e2c9dda5616b486ee6b SystemUUID:ec28d261-95da-4e2c-9dda-5616b486ee6b BootID:31668288-efd1-4b6e-8285-5164eb40513b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fc:79:61:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fc:79:61:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:c2:1f:c1:91:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 14:06:05.851386 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.851382    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 14:06:05.851570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.851490    2580 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 14:06:05.854908 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.854875    2580 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 14:06:05.855075 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.854909    2580 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 14:06:05.855161 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.855081    2580 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 14:06:05.855161 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.855093    2580 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 14:06:05.855263 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.855167    2580 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 14:06:05.855263 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.855192    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 14:06:05.856110 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.856096    2580 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 14:06:05.860213 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.860198    2580 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 14:06:05.860417 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.860397    2580 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 14:06:05.861285 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.861274    2580 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 14:06:05.861334 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.861290    2580 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 14:06:05.861334 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.861302    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 14:06:05.861334 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.861311    2580 kubelet.go:405] "Adding apiserver pod source"
Oct 30 14:06:05.861334 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.861320    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 14:06:05.861670 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.861649    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 14:06:05.864897 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.864531    2580 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 14:06:05.870049 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.870032    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 14:06:05.871021 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871008    2580 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 14:06:05.871078 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871038    2580 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 14:06:05.871195 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871184    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 14:06:05.871236 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871200    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 14:06:05.871236 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871206    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 14:06:05.871236 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871212    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 14:06:05.871236 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871218    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 14:06:05.871236 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871224    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 14:06:05.871721 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871712    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 14:06:05.871751 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871722    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 14:06:05.871751 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871730    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 14:06:05.871751 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871736    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 14:06:05.871751 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871745    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 14:06:05.871900 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.871754    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 14:06:05.873072 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.873063    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 14:06:05.873072 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.873072    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 14:06:05.877049 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.877033    2580 server.go:1263] "Started kubelet"
Oct 30 14:06:05.877128 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.877088    2580 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 14:06:05.877183 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.877142    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 14:06:05.877257 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.877202    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 14:06:05.877778 ip-10-0-132-7 systemd[1]: Started Kubernetes Kubelet.
Oct 30 14:06:05.879274 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.879241    2580 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 14:06:05.883694 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:05.883667    2580 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 14:06:05.916324 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.916292    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 14:06:05.917426 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:05.916294    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-7.ec2.internal.18e353c1333a036e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-7.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-7.ec2.internal,},FirstTimestamp:2026-10-30 14:06:05.876822894 +0000 UTC m=+0.383283649,LastTimestamp:2026-10-30 14:06:05.876822894 +0000 UTC m=+0.383283649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-7.ec2.internal,}"
Oct 30 14:06:05.920451 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.920431    2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 14:06:05.923300 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.923281    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gpvdw"
Oct 30 14:06:05.932215 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:05.932194    2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 14:06:05.932305 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:05.932193    2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 14:06:05.935171 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.935156    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gpvdw"
Oct 30 14:06:05.989686 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.989655    2580 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 14:06:05.994344 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.994323    2580 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 14:06:05.994459 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.994347    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 14:06:05.994459 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:05.994452    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:05.995158 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995138    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 14:06:05.995158 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995139    2580 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 14:06:05.995158 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995163    2580 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 14:06:05.995379 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995210    2580 factory.go:55] Registering systemd factory
Oct 30 14:06:05.995379 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995226    2580 factory.go:223] Registration of the systemd container factory successfully
Oct 30 14:06:05.995379 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995286    2580 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 14:06:05.995379 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995294    2580 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 14:06:05.995525 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995490    2580 factory.go:153] Registering CRI-O factory
Oct 30 14:06:05.995525 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995503    2580 factory.go:223] Registration of the crio container factory successfully
Oct 30 14:06:05.995608 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995559    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 14:06:05.995608 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995575    2580 factory.go:103] Registering Raw factory
Oct 30 14:06:05.995608 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.995585    2580 manager.go:1199] Started watching for new ooms in manager
Oct 30 14:06:05.996561 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:05.996543    2580 manager.go:319] Starting recovery of all containers
Oct 30 14:06:06.007561 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.007539    2580 manager.go:324] Recovery completed
Oct 30 14:06:06.011524 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.011511    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.013278 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013262    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.013370 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013295    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.013370 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013310    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.013868 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013852    2580 cpu_manager.go:226] "Starting" policy="none"
Oct 30 14:06:06.013868 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013866    2580 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 14:06:06.013981 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013868    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.013981 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.013881    2580 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 14:06:06.014534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.014519    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.014574 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.014545    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.014574 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.014555    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.016076 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.016061    2580 policy_none.go:50] "Start"
Oct 30 14:06:06.016076 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.016076    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 14:06:06.016201 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.016087    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 14:06:06.018267 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.018254    2580 policy_none.go:44] "Start"
Oct 30 14:06:06.055943 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.055872    2580 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 14:06:06.057234 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.057215    2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:06.060206 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060184    2580 manager.go:341] "Starting Device Plugin manager"
Oct 30 14:06:06.060328 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.060217    2580 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 14:06:06.060328 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060228    2580 server.go:87] "Starting device plugin registration server"
Oct 30 14:06:06.060484 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060471    2580 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 14:06:06.060538 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060483    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 14:06:06.060593 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060580    2580 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 14:06:06.060675 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060658    2580 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 14:06:06.060675 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.060671    2580 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 14:06:06.061205 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.061187    2580 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 14:06:06.061299 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.061236    2580 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.093551 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.074265    2580 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-7.ec2.internal\" not found" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.119759 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.119588    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 14:06:06.120993 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.120975    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 14:06:06.121077 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.121000    2580 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 14:06:06.121077 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.121026    2580 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 14:06:06.121077 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.121068    2580 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 14:06:06.136035 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.136011    2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:06.160848 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.160827    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.161773 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.161755    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.162200 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.162189    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.162237 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.162204    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.162237 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.162228    2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.182225 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.182204    2580 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.182306 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.182230    2580 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-7.ec2.internal\": node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.222792 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.222761    2580 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"]
Oct 30 14:06:06.222943 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.222821    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.224177 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.224159    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.224290 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.224192    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.224290 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.224205    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.225408 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.225390    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.226569 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.226555    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.226713 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.226700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.226764 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.226727    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.227443 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.227426    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.227514 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.227455    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.227514 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.227465    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.227514 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.227429    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.227600 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.227531    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.227600 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.227547    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.229378 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.229364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.229437 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.229390    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:06.230143 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.230130    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:06.230203 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.230154    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:06.230203 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.230163    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:06.248180 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.248158    2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-7.ec2.internal\" not found" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.251181 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.251156    2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-7.ec2.internal\" not found" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.297090 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.297057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.297090 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.297094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.297308 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.297118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01f7fab24259baa567abf70da12a1430-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"01f7fab24259baa567abf70da12a1430\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.326334 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.326283    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.397699 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.397674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.397785 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.397703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.397785 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.397722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01f7fab24259baa567abf70da12a1430-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"01f7fab24259baa567abf70da12a1430\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.397785 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.397767    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.397911 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.397772    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.397911 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.397778    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01f7fab24259baa567abf70da12a1430-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"01f7fab24259baa567abf70da12a1430\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.426955 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.426918    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.527808 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.527774    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.553933 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.553905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.556214 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.556196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.629397 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.629295    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.729568 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.729524    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.823175 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.823141    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 14:06:06.823708 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.823314    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 14:06:06.823708 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.823354    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 14:06:06.829899 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.829878    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.930782 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:06.930693    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:06.971732 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.971698    2580 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:06.994867 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.994827    2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:06.994867 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.994845    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 14:06:06.995414 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.995374    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 14:01:06 +0000 UTC" deadline="2028-05-27 23:23:21.204987534 +0000 UTC"
Oct 30 14:06:06.995414 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:06.995412    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13809h17m14.209579286s"
Oct 30 14:06:07.022876 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.022847    2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 14:06:07.025376 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.025354    2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:07.047567 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.047543    2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 14:06:07.047787 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.047540    2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 14:06:07.086196 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.086148    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pf6fc"
Oct 30 14:06:07.102100 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.102075    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pf6fc"
Oct 30 14:06:07.197579 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:07.197547    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977bf51bbc68541b82d14af211bb5f03.slice/crio-d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d WatchSource:0}: Error finding container d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d: Status 404 returned error can't find the container with id d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d
Oct 30 14:06:07.197985 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:07.197961    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f7fab24259baa567abf70da12a1430.slice/crio-25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f WatchSource:0}: Error finding container 25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f: Status 404 returned error can't find the container with id 25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f
Oct 30 14:06:07.203546 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.203527    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 14:06:07.482719 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.482629    2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:07.758150 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.758064    2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:07.862617 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.862582    2580 apiserver.go:52] "Watching apiserver"
Oct 30 14:06:07.893446 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.893417    2580 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 14:06:07.893850 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.893827    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vbbts","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk","kube-system/konnectivity-agent-g2tcs","openshift-multus/network-metrics-daemon-j6f9w","openshift-ovn-kubernetes/ovnkube-node-kdjxv","openshift-dns/node-resolver-z4dbd","openshift-image-registry/node-ca-7r6xm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal","openshift-multus/multus-95tj6","openshift-multus/multus-additional-cni-plugins-5lp65","openshift-network-diagnostics/network-check-target-rksrm","kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gq9cb","openshift-network-operator/iptables-alerter-5jjg9"]
Oct 30 14:06:07.896567 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.896531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:07.898979 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.898954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:07.901243 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.901218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:07.904692 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.904671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:07.904793 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:07.904751    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:07.907030 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.907008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:07.907778 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.907755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8815fb-55ec-4632-aa1e-aa519da33bd2-host\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:07.907891 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.907793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd8815fb-55ec-4632-aa1e-aa519da33bd2-serviceca\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:07.907891 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.907820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqh2q\" (UniqueName: \"kubernetes.io/projected/bd8815fb-55ec-4632-aa1e-aa519da33bd2-kube-api-access-hqh2q\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:07.909564 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.909544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:07.912146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.912127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95tj6"
Oct 30 14:06:07.915447 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.915424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:07.915548 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:07.915497    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.916086    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.916294    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.916438    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.916643    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5t6gk\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.916944    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.918310    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-c5nrs\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.918476    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kvlg\""
Oct 30 14:06:07.918653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.918614    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 14:06:07.919119 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.919102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:07.922347 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.921948    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:07.923179 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.923156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:07.923310 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:07.923229    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:07.925668 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.925648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:07.926708 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.926684    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 14:06:07.927003 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.926982    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dqvfb\""
Oct 30 14:06:07.927073 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927061    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 14:06:07.927126 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927107    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkz6n\""
Oct 30 14:06:07.927225 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927187    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 14:06:07.927225 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927213    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 14:06:07.927909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927311    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 14:06:07.927909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927601    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 14:06:07.927909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927668    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 14:06:07.927909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927806    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 14:06:07.927909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927857    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 14:06:07.927909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.927884    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 14:06:07.928955 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.928936    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mfmhk\""
Oct 30 14:06:07.996854 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:07.996824    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 14:06:08.008582 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.008582 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-kubernetes\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.008582 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjfx\" (UniqueName: \"kubernetes.io/projected/365c35a5-ff31-4e62-82bc-da9d408a4ff0-kube-api-access-hhjfx\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9660c039-cb78-44b3-a886-63c1dd6a93d8-iptables-alerter-script\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9660c039-cb78-44b3-a886-63c1dd6a93d8-host-slash\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-netns\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-bin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-sys\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cnibin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-k8s-cni-cncf-io\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.008921 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-conf-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.008971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8zf6\" (UniqueName: \"kubernetes.io/projected/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-kube-api-access-m8zf6\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-lib-modules\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-agent-certs\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-kubelet-config\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bvwl\" (UniqueName: \"kubernetes.io/projected/bbb4015f-b6ef-4a06-8184-4212485732d5-kube-api-access-9bvwl\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-kubelet\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-systemd-units\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fe9083-f455-4f5f-a452-37d368be1769-ovn-node-metrics-cert\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffzk\" (UniqueName: \"kubernetes.io/projected/e0fe9083-f455-4f5f-a452-37d368be1769-kube-api-access-8ffzk\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8815fb-55ec-4632-aa1e-aa519da33bd2-host\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-multus\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.009644 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-hosts-file\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-cnibin\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-slash\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-script-lib\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-device-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-systemd\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-konnectivity-ca\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-netd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bbfg\" (UniqueName: \"kubernetes.io/projected/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kube-api-access-2bbfg\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-tmp\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvlrz\" (UniqueName: \"kubernetes.io/projected/9660c039-cb78-44b3-a886-63c1dd6a93d8-kube-api-access-cvlrz\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.009999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-config\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-socket-dir-parent\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.010467 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-conf\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-tmp-dir\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-tuned\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-dbus\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-etc-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-bin\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-system-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010414    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8815fb-55ec-4632-aa1e-aa519da33bd2-host\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jn5m\" (UniqueName: \"kubernetes.io/projected/eb803507-7db8-4e13-9205-d7b10b8ed945-kube-api-access-4jn5m\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-kubelet\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-modprobe-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-host\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.011086 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-systemd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-netns\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-system-cni-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-log-socket\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cni-binary-copy\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-hostroot\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-multus-certs\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.010999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kxq\" (UniqueName: \"kubernetes.io/projected/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-kube-api-access-j9kxq\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd8815fb-55ec-4632-aa1e-aa519da33bd2-serviceca\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqh2q\" (UniqueName: \"kubernetes.io/projected/bd8815fb-55ec-4632-aa1e-aa519da33bd2-kube-api-access-hqh2q\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-ovn\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-env-overrides\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-daemon-config\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysconfig\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.011817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-run\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.012534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-var-lib-kubelet\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.012534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-var-lib-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.012534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-node-log\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.012534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-etc-kubernetes\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.012534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.011662    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd8815fb-55ec-4632-aa1e-aa519da33bd2-serviceca\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.021802 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.021773    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 14:06:08.021946 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.021779    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022233    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022289    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94q7c\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022306    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w5lxm\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022380    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022350    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022404    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022356    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022326    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022428    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mlbs5\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022293    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022484    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 14:06:08.022907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022863    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 14:06:08.023461 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.022971    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 14:06:08.035826 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.035789    2580 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 14:06:08.040504 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.040475    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqh2q\" (UniqueName: \"kubernetes.io/projected/bd8815fb-55ec-4632-aa1e-aa519da33bd2-kube-api-access-hqh2q\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.096498 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.096457    2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:08.105385 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.105345    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 14:01:07 +0000 UTC" deadline="2028-04-04 06:48:31.820991411 +0000 UTC"
Oct 30 14:06:08.105385 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.105380    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12520h42m23.715617105s"
Oct 30 14:06:08.112084 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-systemd\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.112245 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-konnectivity-ca\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.112245 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-netd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.112245 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bbfg\" (UniqueName: \"kubernetes.io/projected/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kube-api-access-2bbfg\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.112245 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-tmp\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.112245 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.112245 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvlrz\" (UniqueName: \"kubernetes.io/projected/9660c039-cb78-44b3-a886-63c1dd6a93d8-kube-api-access-cvlrz\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-config\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-socket-dir-parent\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-conf\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-tmp-dir\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-tuned\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-dbus\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-etc-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-bin\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-system-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.112607 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jn5m\" (UniqueName: \"kubernetes.io/projected/eb803507-7db8-4e13-9205-d7b10b8ed945-kube-api-access-4jn5m\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-kubelet\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-modprobe-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-host\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112790    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-konnectivity-ca\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112833    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-systemd\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.112885    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112901    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-host\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112968    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-dbus\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.113262 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.112982    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:08.612940793 +0000 UTC m=+3.119401559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113302    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-modprobe-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-etc-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113400    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-config\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113438    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-kubelet\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-systemd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-netns\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113502    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113559    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-systemd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-system-cni-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-log-socket\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113630    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cni-binary-copy\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113641    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-conf\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113499    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-socket-dir-parent\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-hostroot\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-multus-certs\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.113852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113706    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-log-socket\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113755    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-system-cni-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kxq\" (UniqueName: \"kubernetes.io/projected/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-kube-api-access-j9kxq\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113804    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-bin\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113809    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-hostroot\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113880    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-system-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.112388    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-netd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113926    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-tmp-dir\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113917    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-netns\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.113960    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.113995    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114019    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-multus-certs\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-ovn\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.114076    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret podName:2a21de7b-d2bd-4174-aee2-047a16242992 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:08.614060757 +0000 UTC m=+3.120521501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret") pod "global-pull-secret-syncer-vbbts" (UID: "2a21de7b-d2bd-4174-aee2-047a16242992") : object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:08.114767 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-env-overrides\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-daemon-config\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114249    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-ovn\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysconfig\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-run\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114384    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-run\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114396    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysconfig\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-var-lib-kubelet\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-var-lib-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-node-log\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-etc-kubernetes\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114551    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-env-overrides\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114585    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114609    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-node-log\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114613    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114585    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cni-binary-copy\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-kubernetes\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.115630 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114629    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-var-lib-kubelet\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114642    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114641    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-var-lib-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114678    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-kubernetes\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjfx\" (UniqueName: \"kubernetes.io/projected/365c35a5-ff31-4e62-82bc-da9d408a4ff0-kube-api-access-hhjfx\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114692    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-etc-kubernetes\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9660c039-cb78-44b3-a886-63c1dd6a93d8-iptables-alerter-script\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9660c039-cb78-44b3-a886-63c1dd6a93d8-host-slash\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114845    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-daemon-config\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9660c039-cb78-44b3-a886-63c1dd6a93d8-host-slash\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-netns\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.114996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-bin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115038    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-bin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115079    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-netns\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115080    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.116531 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115089    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-sys\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-sys\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115115    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cnibin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-k8s-cni-cncf-io\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-conf-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115190    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cnibin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8zf6\" (UniqueName: \"kubernetes.io/projected/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-kube-api-access-m8zf6\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115221    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-k8s-cni-cncf-io\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-lib-modules\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-agent-certs\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-kubelet-config\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115326    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-conf-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvwl\" (UniqueName: \"kubernetes.io/projected/bbb4015f-b6ef-4a06-8184-4212485732d5-kube-api-access-9bvwl\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-kubelet\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115385    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-lib-modules\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-systemd-units\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.117387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115436    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-kubelet\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fe9083-f455-4f5f-a452-37d368be1769-ovn-node-metrics-cert\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffzk\" (UniqueName: \"kubernetes.io/projected/e0fe9083-f455-4f5f-a452-37d368be1769-kube-api-access-8ffzk\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115514    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-systemd-units\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115584    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-kubelet-config\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115644    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115649    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115681    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-multus\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115737    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-hosts-file\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-cnibin\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115767    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-multus\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115808    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-cnibin\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.118269 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-slash\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-script-lib\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115864    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-hosts-file\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-device-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115902    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-slash\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.115910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.116040    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-device-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.117095    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9660c039-cb78-44b3-a886-63c1dd6a93d8-iptables-alerter-script\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.119146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.117834    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-script-lib\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.119632 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.119610    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.123636 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.123588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-agent-certs\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.124281 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.124248    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-tmp\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.124817 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.124793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-tuned\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.127636 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.127580    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fe9083-f455-4f5f-a452-37d368be1769-ovn-node-metrics-cert\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.130789 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.130661    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" event={"ID":"01f7fab24259baa567abf70da12a1430","Type":"ContainerStarted","Data":"25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f"}
Oct 30 14:06:08.132190 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.132164    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"977bf51bbc68541b82d14af211bb5f03","Type":"ContainerStarted","Data":"d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d"}
Oct 30 14:06:08.140182 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.140157    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 14:06:08.140316 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.140191    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 14:06:08.140316 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.140206    2580 projected.go:196] Error preparing data for projected volume kube-api-access-j8v2n for pod openshift-network-diagnostics/network-check-target-rksrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:08.140316 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.140288    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n podName:7245c5d9-0734-406c-a2bf-ff06c31c791a nodeName:}" failed. No retries permitted until 2026-10-30 14:06:08.640251443 +0000 UTC m=+3.146712211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j8v2n" (UniqueName: "kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n") pod "network-check-target-rksrm" (UID: "7245c5d9-0734-406c-a2bf-ff06c31c791a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:08.141760 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.141722    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bbfg\" (UniqueName: \"kubernetes.io/projected/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kube-api-access-2bbfg\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.142336 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.142239    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jn5m\" (UniqueName: \"kubernetes.io/projected/eb803507-7db8-4e13-9205-d7b10b8ed945-kube-api-access-4jn5m\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.144044 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.143594    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvlrz\" (UniqueName: \"kubernetes.io/projected/9660c039-cb78-44b3-a886-63c1dd6a93d8-kube-api-access-cvlrz\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.144140 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.144101    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8zf6\" (UniqueName: \"kubernetes.io/projected/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-kube-api-access-m8zf6\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.145196 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.145168    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvwl\" (UniqueName: \"kubernetes.io/projected/bbb4015f-b6ef-4a06-8184-4212485732d5-kube-api-access-9bvwl\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.146507 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.146489    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kxq\" (UniqueName: \"kubernetes.io/projected/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-kube-api-access-j9kxq\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.148781 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.148738    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjfx\" (UniqueName: \"kubernetes.io/projected/365c35a5-ff31-4e62-82bc-da9d408a4ff0-kube-api-access-hhjfx\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:08.153324 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.153299    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffzk\" (UniqueName: \"kubernetes.io/projected/e0fe9083-f455-4f5f-a452-37d368be1769-kube-api-access-8ffzk\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.211894 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.211861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:08.223308 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.223278    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8815fb_55ec_4632_aa1e_aa519da33bd2.slice/crio-9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239 WatchSource:0}: Error finding container 9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239: Status 404 returned error can't find the container with id 9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239
Oct 30 14:06:08.224496 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.224467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:08.233716 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.233688    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb803507_7db8_4e13_9205_d7b10b8ed945.slice/crio-6cf1455a3647b83782642890c9ebab42bac369144e11f135f286a799a5d59474 WatchSource:0}: Error finding container 6cf1455a3647b83782642890c9ebab42bac369144e11f135f286a799a5d59474: Status 404 returned error can't find the container with id 6cf1455a3647b83782642890c9ebab42bac369144e11f135f286a799a5d59474
Oct 30 14:06:08.234849 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.234827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:08.246195 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.245601    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbb0acc_a13c_4ca6_b00f_69e4c03eca15.slice/crio-4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812 WatchSource:0}: Error finding container 4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812: Status 404 returned error can't find the container with id 4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812
Oct 30 14:06:08.254446 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.254423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:08.261904 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.261869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:08.263494 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.263475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-95tj6"
Oct 30 14:06:08.265796 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.265769    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb64a6c_627a_4c9e_a8a9_9d2fdfead9f7.slice/crio-48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa WatchSource:0}: Error finding container 48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa: Status 404 returned error can't find the container with id 48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa
Oct 30 14:06:08.271792 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.271745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:08.277726 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.277677    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fe9083_f455_4f5f_a452_37d368be1769.slice/crio-959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0 WatchSource:0}: Error finding container 959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0: Status 404 returned error can't find the container with id 959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0
Oct 30 14:06:08.282068 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.282032    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e38e39_299e_4d1f_ab21_aed0321cf7b1.slice/crio-7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823 WatchSource:0}: Error finding container 7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823: Status 404 returned error can't find the container with id 7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823
Oct 30 14:06:08.287314 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.287292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:08.292822 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.292798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:08.300463 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.300430    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9660c039_cb78_44b3_a886_63c1dd6a93d8.slice/crio-807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564 WatchSource:0}: Error finding container 807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564: Status 404 returned error can't find the container with id 807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564
Oct 30 14:06:08.304533 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:08.304509    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb4015f_b6ef_4a06_8184_4212485732d5.slice/crio-2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76 WatchSource:0}: Error finding container 2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76: Status 404 returned error can't find the container with id 2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76
Oct 30 14:06:08.623973 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.623883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:08.623973 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.623968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:08.624187 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.624120    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:08.624222 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.624200    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret podName:2a21de7b-d2bd-4174-aee2-047a16242992 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:09.624167305 +0000 UTC m=+4.130628065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret") pod "global-pull-secret-syncer-vbbts" (UID: "2a21de7b-d2bd-4174-aee2-047a16242992") : object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:08.624469 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.624447    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:08.624597 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.624511    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:09.624493852 +0000 UTC m=+4.130954603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:08.725871 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:08.725114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:08.725871 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.725349    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 14:06:08.725871 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.725377    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 14:06:08.725871 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.725392    2580 projected.go:196] Error preparing data for projected volume kube-api-access-j8v2n for pod openshift-network-diagnostics/network-check-target-rksrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:08.725871 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:08.725487    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n podName:7245c5d9-0734-406c-a2bf-ff06c31c791a nodeName:}" failed. No retries permitted until 2026-10-30 14:06:09.725464531 +0000 UTC m=+4.231925292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8v2n" (UniqueName: "kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n") pod "network-check-target-rksrm" (UID: "7245c5d9-0734-406c-a2bf-ff06c31c791a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:09.109591 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.109523    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 14:01:07 +0000 UTC" deadline="2028-07-03 03:48:21.431821167 +0000 UTC"
Oct 30 14:06:09.109591 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.109588    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14677h42m12.322237003s"
Oct 30 14:06:09.121840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.121233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:09.121840 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.121374    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:09.121840 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.121687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:09.121840 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.121783    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:09.144311 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.144162    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk" event={"ID":"ee1ea063-3567-4b9e-a55f-ecea343bc7f0","Type":"ContainerStarted","Data":"d914a5b06804a35e95f2c18d03b418f3d0a60e5d5616ee30b179f64620c7de7c"}
Oct 30 14:06:09.147945 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.147872    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4dbd" event={"ID":"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7","Type":"ContainerStarted","Data":"48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa"}
Oct 30 14:06:09.149544 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.149458    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g2tcs" event={"ID":"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15","Type":"ContainerStarted","Data":"4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812"}
Oct 30 14:06:09.154884 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.154852    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gq9cb" event={"ID":"eb803507-7db8-4e13-9205-d7b10b8ed945","Type":"ContainerStarted","Data":"6cf1455a3647b83782642890c9ebab42bac369144e11f135f286a799a5d59474"}
Oct 30 14:06:09.164039 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.163949    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7r6xm" event={"ID":"bd8815fb-55ec-4632-aa1e-aa519da33bd2","Type":"ContainerStarted","Data":"9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239"}
Oct 30 14:06:09.174215 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.174120    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerStarted","Data":"2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76"}
Oct 30 14:06:09.176159 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.176078    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jjg9" event={"ID":"9660c039-cb78-44b3-a886-63c1dd6a93d8","Type":"ContainerStarted","Data":"807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564"}
Oct 30 14:06:09.191570 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.191527    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95tj6" event={"ID":"e5e38e39-299e-4d1f-ab21-aed0321cf7b1","Type":"ContainerStarted","Data":"7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823"}
Oct 30 14:06:09.202567 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.202106    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0"}
Oct 30 14:06:09.634124 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.633667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:09.634124 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.633947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:09.634124 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.633854    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:09.634124 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.634049    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:11.634027316 +0000 UTC m=+6.140488085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:09.634124 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.634059    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:09.634124 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.634099    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret podName:2a21de7b-d2bd-4174-aee2-047a16242992 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:11.634088302 +0000 UTC m=+6.140549051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret") pod "global-pull-secret-syncer-vbbts" (UID: "2a21de7b-d2bd-4174-aee2-047a16242992") : object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:09.734360 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:09.734273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:09.735027 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.734551    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 14:06:09.735027 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.734579    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 14:06:09.735027 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.734592    2580 projected.go:196] Error preparing data for projected volume kube-api-access-j8v2n for pod openshift-network-diagnostics/network-check-target-rksrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:09.735027 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:09.734649    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n podName:7245c5d9-0734-406c-a2bf-ff06c31c791a nodeName:}" failed. No retries permitted until 2026-10-30 14:06:11.734629413 +0000 UTC m=+6.241090173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8v2n" (UniqueName: "kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n") pod "network-check-target-rksrm" (UID: "7245c5d9-0734-406c-a2bf-ff06c31c791a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:10.122616 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:10.122558    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:10.123238 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:10.122716    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:10.249407 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:10.249365    2580 generic.go:356] "Generic (PLEG): container finished" podID="977bf51bbc68541b82d14af211bb5f03" containerID="903c754d3fc7c8eb13beff08b41219464874b1e7461056e07640369f192f2d59" exitCode=0
Oct 30 14:06:10.250134 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:10.250105    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"977bf51bbc68541b82d14af211bb5f03","Type":"ContainerDied","Data":"903c754d3fc7c8eb13beff08b41219464874b1e7461056e07640369f192f2d59"}
Oct 30 14:06:10.264510 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:10.258994    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" event={"ID":"01f7fab24259baa567abf70da12a1430","Type":"ContainerStarted","Data":"719fe77a6ae29daf1312a1a95a818510423dddde47eb843eff115e8b93185529"}
Oct 30 14:06:11.121425 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.121384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:11.121583 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.121514    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:11.121918 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.121898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:11.122042 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.122007    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:11.267527 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.267453    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"977bf51bbc68541b82d14af211bb5f03","Type":"ContainerStarted","Data":"35cbea540601ffadad6b82e0ae458e577299b44e2b9aa8339f34767290fc1018"}
Oct 30 14:06:11.312598 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.311363    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" podStartSLOduration=4.311342182 podStartE2EDuration="4.311342182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:10.335824274 +0000 UTC m=+4.842285042" watchObservedRunningTime="2026-10-30 14:06:11.311342182 +0000 UTC m=+5.817802953"
Oct 30 14:06:11.659145 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.659067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:11.659297 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.659163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:11.659383 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.659305    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:11.659383 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.659371    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:15.659350053 +0000 UTC m=+10.165810811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:11.659798 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.659776    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:11.659891 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.659831    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret podName:2a21de7b-d2bd-4174-aee2-047a16242992 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:15.659819562 +0000 UTC m=+10.166280320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret") pod "global-pull-secret-syncer-vbbts" (UID: "2a21de7b-d2bd-4174-aee2-047a16242992") : object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:11.759873 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:11.759837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:11.760096 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.760079    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 14:06:11.760173 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.760105    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 14:06:11.760173 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.760120    2580 projected.go:196] Error preparing data for projected volume kube-api-access-j8v2n for pod openshift-network-diagnostics/network-check-target-rksrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:11.760556 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:11.760331    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n podName:7245c5d9-0734-406c-a2bf-ff06c31c791a nodeName:}" failed. No retries permitted until 2026-10-30 14:06:15.760162947 +0000 UTC m=+10.266623707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8v2n" (UniqueName: "kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n") pod "network-check-target-rksrm" (UID: "7245c5d9-0734-406c-a2bf-ff06c31c791a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:12.122466 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:12.122432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:12.122648 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:12.122582    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:12.274137 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:12.273522    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="29053a8fee3bdfce7e491ee06e84a6b82aa578ce90f49cc19b4b54d3b768c457" exitCode=0
Oct 30 14:06:12.274137 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:12.274072    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerDied","Data":"29053a8fee3bdfce7e491ee06e84a6b82aa578ce90f49cc19b4b54d3b768c457"}
Oct 30 14:06:12.333544 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:12.333490    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" podStartSLOduration=5.333475467 podStartE2EDuration="5.333475467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:11.312570058 +0000 UTC m=+5.819030826" watchObservedRunningTime="2026-10-30 14:06:12.333475467 +0000 UTC m=+6.839936231"
Oct 30 14:06:13.123022 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:13.122445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:13.123022 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:13.122540    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:13.123022 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:13.122876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:13.123022 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:13.122968    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:13.280608 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:13.280551    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g2tcs" event={"ID":"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15","Type":"ContainerStarted","Data":"ca0a359003f9271b4cf9e29a6791390a2244b5074f81b824ada6b45d8cfa7b79"}
Oct 30 14:06:14.124510 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:14.124478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:14.124675 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:14.124619    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:14.287694 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:14.287608    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7r6xm" event={"ID":"bd8815fb-55ec-4632-aa1e-aa519da33bd2","Type":"ContainerStarted","Data":"6430fc78f041202947255b44b1b0f0eae6499e3897b06a8c1f414ddcef2ae8e8"}
Oct 30 14:06:14.328312 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:14.328196    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g2tcs" podStartSLOduration=4.305848124 podStartE2EDuration="8.328177972s" totalImagesPullingTime="4.022329848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:13.321343267 +0000 UTC m=+7.827804042" watchObservedRunningTime="2026-10-30 14:06:14.328177972 +0000 UTC m=+8.834638738"
Oct 30 14:06:15.122276 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.122158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:15.122450 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.122301    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:15.122754 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.122595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:15.122754 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.122691    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:15.309258 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.305323    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk" event={"ID":"ee1ea063-3567-4b9e-a55f-ecea343bc7f0","Type":"ContainerStarted","Data":"3d03c3d472da27895b33a7dc41822344ce2df002177d18aa68e6cb8d0839c379"}
Oct 30 14:06:15.693576 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.692851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:15.693576 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.692922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:15.693576 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.693069    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:15.693576 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.693129    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret podName:2a21de7b-d2bd-4174-aee2-047a16242992 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:23.693110145 +0000 UTC m=+18.199570907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret") pod "global-pull-secret-syncer-vbbts" (UID: "2a21de7b-d2bd-4174-aee2-047a16242992") : object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:15.693576 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.693198    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:15.693576 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.693236    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:23.693223209 +0000 UTC m=+18.199683966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:15.795166 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.794165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:15.795166 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.794338    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 14:06:15.795166 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.794360    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 14:06:15.795166 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.794374    2580 projected.go:196] Error preparing data for projected volume kube-api-access-j8v2n for pod openshift-network-diagnostics/network-check-target-rksrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:15.795166 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:15.794434    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n podName:7245c5d9-0734-406c-a2bf-ff06c31c791a nodeName:}" failed. No retries permitted until 2026-10-30 14:06:23.794414345 +0000 UTC m=+18.300875093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8v2n" (UniqueName: "kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n") pod "network-check-target-rksrm" (UID: "7245c5d9-0734-406c-a2bf-ff06c31c791a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:15.917533 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:15.917507    2580 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 14:06:16.066387 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.066288    2580 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T14:06:15.917526381Z","UUID":"e1376a86-1ca4-41b1-862b-31598b910097","Handler":null,"Name":"","Endpoint":""}
Oct 30 14:06:16.067766 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.067740    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 14:06:16.067891 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.067774    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 14:06:16.122549 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.122518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:16.122694 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:16.122639    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:16.307925 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.307891    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk" event={"ID":"ee1ea063-3567-4b9e-a55f-ecea343bc7f0","Type":"ContainerStarted","Data":"9712ad4239dcab030ce301ba7903d38fb6cbc7ab4ac1b3470f1de65e2cc5c14f"}
Oct 30 14:06:16.309694 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.309645    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-95tj6" event={"ID":"e5e38e39-299e-4d1f-ab21-aed0321cf7b1","Type":"ContainerStarted","Data":"e39c04bd31da0d737764cdfe999edcba92f70ac274e5ad26a191bffa5d270815"}
Oct 30 14:06:16.352897 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.352836    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7r6xm" podStartSLOduration=5.34136214 podStartE2EDuration="10.352818311s" totalImagesPullingTime="5.011456171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:14.32851697 +0000 UTC m=+8.834977735" watchObservedRunningTime="2026-10-30 14:06:16.352818311 +0000 UTC m=+10.859279076"
Oct 30 14:06:16.353054 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.352992    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-95tj6" podStartSLOduration=2.984501418 podStartE2EDuration="10.352983863s" totalImagesPullingTime="7.368482445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:16.352361324 +0000 UTC m=+10.858822091" watchObservedRunningTime="2026-10-30 14:06:16.352983863 +0000 UTC m=+10.859444628"
Oct 30 14:06:16.489948 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.489916    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:16.490843 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:16.490820    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:17.122348 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.122170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:17.122483 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:17.122420    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:17.122483 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.122476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:17.122585 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:17.122528    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:17.315462 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.315132    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="265e7ef75277f5da430bf401ff6b5675b6762160b36e818f61fa31bff3fb0755" exitCode=0
Oct 30 14:06:17.315462 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.315230    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerDied","Data":"265e7ef75277f5da430bf401ff6b5675b6762160b36e818f61fa31bff3fb0755"}
Oct 30 14:06:17.318046 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.318019    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk" event={"ID":"ee1ea063-3567-4b9e-a55f-ecea343bc7f0","Type":"ContainerStarted","Data":"6032c3630211ab29b1a59bc74ef164c8ab5a09a49d12f07ec4b6f11421d1ed77"}
Oct 30 14:06:17.319702 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.319677    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4dbd" event={"ID":"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7","Type":"ContainerStarted","Data":"a3ef08de9ab0e4baaee50b9b04112dbae9fad71248569fa4695adc0c8dae0dcc"}
Oct 30 14:06:17.320280 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.320264    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:17.320673 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.320642    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:17.407433 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.407232    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-z4dbd" podStartSLOduration=3.42269088 podStartE2EDuration="11.40721664s" totalImagesPullingTime="7.98452576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:17.40650485 +0000 UTC m=+11.912965615" watchObservedRunningTime="2026-10-30 14:06:17.40721664 +0000 UTC m=+11.913677405"
Oct 30 14:06:17.450291 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:17.450219    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk" podStartSLOduration=3.14789315 podStartE2EDuration="11.450199694s" totalImagesPullingTime="8.302306544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:17.449740188 +0000 UTC m=+11.956200952" watchObservedRunningTime="2026-10-30 14:06:17.450199694 +0000 UTC m=+11.956660462"
Oct 30 14:06:18.126135 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:18.126108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:18.126314 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:18.126235    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:18.324819 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:18.324787    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="1ab3d8757b6b480aa773bebba09fd578695bd777fa7eda8760292f6b354ce911" exitCode=0
Oct 30 14:06:18.325263 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:18.324868    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerDied","Data":"1ab3d8757b6b480aa773bebba09fd578695bd777fa7eda8760292f6b354ce911"}
Oct 30 14:06:18.326720 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:18.326694    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jjg9" event={"ID":"9660c039-cb78-44b3-a886-63c1dd6a93d8","Type":"ContainerStarted","Data":"4e8af4930c1e26a8747e70f51fbd27245cfdc3c450878a0c3b5f6bbc7555b86f"}
Oct 30 14:06:18.414338 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:18.414273    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5jjg9" podStartSLOduration=4.177881991 podStartE2EDuration="12.414241409s" totalImagesPullingTime="8.236359418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:18.414005463 +0000 UTC m=+12.920466223" watchObservedRunningTime="2026-10-30 14:06:18.414241409 +0000 UTC m=+12.920702173"
Oct 30 14:06:19.122020 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:19.121991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:19.122163 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:19.122005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:19.122163 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:19.122101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:19.122163 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:19.122148    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:19.330568 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:19.330478    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gq9cb" event={"ID":"eb803507-7db8-4e13-9205-d7b10b8ed945","Type":"ContainerStarted","Data":"7e815df2d699d774afc9a9f21ac1c67515f88084beb40fd2d17762e99743173c"}
Oct 30 14:06:19.333129 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:19.333099    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="ef9fcb67deffb222a733e2d08c384375b0cc8c3fb4d1f4069427127e1c335437" exitCode=0
Oct 30 14:06:19.333259 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:19.333159    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerDied","Data":"ef9fcb67deffb222a733e2d08c384375b0cc8c3fb4d1f4069427127e1c335437"}
Oct 30 14:06:19.372534 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:19.372480    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gq9cb" podStartSLOduration=3.035025524 podStartE2EDuration="13.372466422s" totalImagesPullingTime="10.337440898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:19.372101064 +0000 UTC m=+13.878561867" watchObservedRunningTime="2026-10-30 14:06:19.372466422 +0000 UTC m=+13.878927186"
Oct 30 14:06:20.125595 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:20.125566    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:20.125775 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:20.125684    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:21.121896 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:21.121861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:21.121896 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:21.121891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:21.122648 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:21.121974    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:21.122648 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:21.122107    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:21.341667 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:21.341630    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerStarted","Data":"c04d7b53b8c0f27cb6873bbea70cb2fd4da062632b9a2bcdb6c4451c64be5e6c"}
Oct 30 14:06:22.121933 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:22.121678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:22.122404 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:22.122048    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:22.347278 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:22.347222    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="c04d7b53b8c0f27cb6873bbea70cb2fd4da062632b9a2bcdb6c4451c64be5e6c" exitCode=0
Oct 30 14:06:22.347501 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:22.347276    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerDied","Data":"c04d7b53b8c0f27cb6873bbea70cb2fd4da062632b9a2bcdb6c4451c64be5e6c"}
Oct 30 14:06:23.121964 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.121946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:23.122383 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.121979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:23.122383 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.122068    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:23.122383 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.122142    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:23.352391 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.352180    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"7d2736f2a3ed2cd13dae7a3f3f9d6b868d43071f3d353efd0298647134660085"}
Oct 30 14:06:23.352542 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.352434    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"d23db49246655a938968abfb45e73cb421ac55171fadd7e6ada8cc84a910e5d4"}
Oct 30 14:06:23.352542 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.352484    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"a716a66beb62039a4fcc061ad0598eaf392c201f8bbb30abf720eef459e18b40"}
Oct 30 14:06:23.352542 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.352531    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"f18164534728e16404fb38e82ca5bce1f9d50277c90da4eec76b25b5c8c753eb"}
Oct 30 14:06:23.352653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.352577    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"353b5d912a7a76cb36927ab6c79a9383494c72ec8fe717d3a6e45a836febf894"}
Oct 30 14:06:23.352653 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.352622    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"2df57d6cbd395478a177cc6f7f521036cf9359f0111b815bb3714da75e92e593"}
Oct 30 14:06:23.355168 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.355140    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="4b3c27428cc91dfb711b51d5a16714c211ae07d9cad7b5fe43c6dc5875a9f8c0" exitCode=0
Oct 30 14:06:23.355277 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.355180    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerDied","Data":"4b3c27428cc91dfb711b51d5a16714c211ae07d9cad7b5fe43c6dc5875a9f8c0"}
Oct 30 14:06:23.753751 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.753676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:23.753751 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.753725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:23.753928 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.753802    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:23.753928 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.753844    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret podName:2a21de7b-d2bd-4174-aee2-047a16242992 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:39.753831624 +0000 UTC m=+34.260292380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret") pod "global-pull-secret-syncer-vbbts" (UID: "2a21de7b-d2bd-4174-aee2-047a16242992") : object "kube-system"/"original-pull-secret" not registered
Oct 30 14:06:23.753928 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.753802    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:23.753928 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.753911    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:39.753898902 +0000 UTC m=+34.260359643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 14:06:23.854772 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:23.854743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:23.854889 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.854874    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 14:06:23.854937 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.854892    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 14:06:23.854937 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.854902    2580 projected.go:196] Error preparing data for projected volume kube-api-access-j8v2n for pod openshift-network-diagnostics/network-check-target-rksrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:23.854995 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:23.854943    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n podName:7245c5d9-0734-406c-a2bf-ff06c31c791a nodeName:}" failed. No retries permitted until 2026-10-30 14:06:39.854930912 +0000 UTC m=+34.361391658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8v2n" (UniqueName: "kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n") pod "network-check-target-rksrm" (UID: "7245c5d9-0734-406c-a2bf-ff06c31c791a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 14:06:24.124592 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:24.124567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:24.124936 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:24.124665    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:24.360129 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:24.360094    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lp65" event={"ID":"bbb4015f-b6ef-4a06-8184-4212485732d5","Type":"ContainerStarted","Data":"5667eac45e13e4dc84a1ac2d8c40b973590d72316634d2dc6e8433acbed68110"}
Oct 30 14:06:24.431670 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:24.431594    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5lp65" podStartSLOduration=8.132314058 podStartE2EDuration="18.431581832s" totalImagesPullingTime="10.299267774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:24.431370125 +0000 UTC m=+18.937830915" watchObservedRunningTime="2026-10-30 14:06:24.431581832 +0000 UTC m=+18.938042595"
Oct 30 14:06:25.122094 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:25.122068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:25.122094 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:25.122099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:25.122311 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:25.122178    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:25.122358 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:25.122315    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:25.364846 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:25.364813    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"22ac6d24f995a15586c7e10f61a129720d2d088826d1b79a93b131b32f9481a3"}
Oct 30 14:06:26.125393 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:26.125366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:26.125528 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:26.125452    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:27.121907 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.121877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:27.122489 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:27.122016    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:27.122489 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.122058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:27.122489 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:27.122130    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:27.372052 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.371966    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" event={"ID":"e0fe9083-f455-4f5f-a452-37d368be1769","Type":"ContainerStarted","Data":"e1b2ac02d91988d8743e010844ce15f0baf20c5d4f9574adcfffc52f0ccddade"}
Oct 30 14:06:27.372296 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.372272    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:27.372394 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.372337    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:27.372394 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.372387    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:27.387194 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.387166    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:27.387695 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.387676    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:27.461686 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:27.461633    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv" podStartSLOduration=6.947039187 podStartE2EDuration="21.461620217s" totalImagesPullingTime="14.51458103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:27.461023252 +0000 UTC m=+21.967484015" watchObservedRunningTime="2026-10-30 14:06:27.461620217 +0000 UTC m=+21.968080980"
Oct 30 14:06:28.121871 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:28.121700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:28.122006 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:28.121947    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:29.121901 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.121872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:29.122054 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:29.121989    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:29.122054 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.122041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:29.122404 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:29.122146    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:29.351942 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.351914    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rksrm"]
Oct 30 14:06:29.352578 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.352546    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j6f9w"]
Oct 30 14:06:29.352686 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.352665    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:29.352781 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:29.352763    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:29.363118 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.363094    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vbbts"]
Oct 30 14:06:29.375626 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.375598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:29.375626 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:29.375611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:29.375753 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:29.375704    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:29.375808 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:29.375776    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:31.121166 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:31.121130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:31.121577 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:31.121226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:31.121577 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:31.121234    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:31.121577 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:31.121263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:31.121577 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:31.121323    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:31.121577 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:31.121379    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:33.121852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:33.121812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:33.121852 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:33.121845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:33.122414 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:33.121930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:33.122414 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:33.121936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:33.122414 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:33.122018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:33.122414 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:33.122093    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:35.121530 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.121501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:35.121901 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.121557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:35.121901 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.121650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:35.121901 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:35.121646    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbbts" podUID="2a21de7b-d2bd-4174-aee2-047a16242992"
Oct 30 14:06:35.121901 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:35.121745    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j6f9w" podUID="365c35a5-ff31-4e62-82bc-da9d408a4ff0"
Oct 30 14:06:35.121901 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:35.121825    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rksrm" podUID="7245c5d9-0734-406c-a2bf-ff06c31c791a"
Oct 30 14:06:35.203849 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.203824    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeReady"
Oct 30 14:06:35.203972 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.203933    2580 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 14:06:35.263179 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.263154    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gfk9t"]
Oct 30 14:06:35.265982 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.265963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.266348 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.266323    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ws6jd"]
Oct 30 14:06:35.268849 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.268831    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.281218 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.281202    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 14:06:35.281332 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.281304    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 14:06:35.281415 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.281380    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 14:06:35.281415 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.281398    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-4w84p\""
Oct 30 14:06:35.285389 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.285367    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfk9t"]
Oct 30 14:06:35.293932 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.293913    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ws6jd"]
Oct 30 14:06:35.347166 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.347142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgqb9\" (UniqueName: \"kubernetes.io/projected/62ce59d3-403d-403e-b150-805154000f23-kube-api-access-bgqb9\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.347284 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.347172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62ce59d3-403d-403e-b150-805154000f23-cert\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.382163 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.382145    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 14:06:35.382270 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.382167    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 14:06:35.382270 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.382173    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x2qs\""
Oct 30 14:06:35.448466 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.448437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-tmp-dir\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.448466 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.448469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8t5\" (UniqueName: \"kubernetes.io/projected/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-kube-api-access-rn8t5\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.448679 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.448491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqb9\" (UniqueName: \"kubernetes.io/projected/62ce59d3-403d-403e-b150-805154000f23-kube-api-access-bgqb9\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.448679 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.448568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-config-volume\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.448770 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.448678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62ce59d3-403d-403e-b150-805154000f23-cert\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.448770 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.448698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.452500 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.452477    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62ce59d3-403d-403e-b150-805154000f23-cert\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.473416 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.473388    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqb9\" (UniqueName: \"kubernetes.io/projected/62ce59d3-403d-403e-b150-805154000f23-kube-api-access-bgqb9\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.550042 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.549962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-tmp-dir\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.550042 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.550009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8t5\" (UniqueName: \"kubernetes.io/projected/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-kube-api-access-rn8t5\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.550042 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.550043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-config-volume\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.550300 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.550071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.550300 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:35.550239    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:35.550403 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:35.550317    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:36.050301331 +0000 UTC m=+30.556762074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:35.550403 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.550355    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-tmp-dir\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.550643 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.550622    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-config-volume\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.573918 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.573891    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8t5\" (UniqueName: \"kubernetes.io/projected/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-kube-api-access-rn8t5\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:35.577802 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.577784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:35.881999 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:35.881968    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfk9t"]
Oct 30 14:06:35.888381 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:35.888356    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ce59d3_403d_403e_b150_805154000f23.slice/crio-f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309 WatchSource:0}: Error finding container f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309: Status 404 returned error can't find the container with id f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309
Oct 30 14:06:36.054071 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:36.054042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:36.054543 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:36.054302    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:36.054637 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:36.054601    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:37.054570456 +0000 UTC m=+31.561031225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:36.390885 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:36.390852    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfk9t" event={"ID":"62ce59d3-403d-403e-b150-805154000f23","Type":"ContainerStarted","Data":"f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309"}
Oct 30 14:06:37.061556 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.061520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:37.061719 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:37.061646    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:37.061719 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:37.061701    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:39.061688979 +0000 UTC m=+33.568149734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:37.121560 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.121529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:37.121560 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.121556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:37.121953 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.121927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:37.137334 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.137313    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 14:06:37.137428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.137379    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rgz8z\""
Oct 30 14:06:37.137428 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.137383    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 14:06:37.137540 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.137428    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z4lqh\""
Oct 30 14:06:37.137540 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.137459    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 14:06:37.137540 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.137487    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2dqn6\""
Oct 30 14:06:37.149069 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:37.149051    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 14:06:39.075409 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.075379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:39.075796 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:39.075514    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:39.075796 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:39.075585    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:43.075566844 +0000 UTC m=+37.582027592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:39.399127 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.399098    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfk9t" event={"ID":"62ce59d3-403d-403e-b150-805154000f23","Type":"ContainerStarted","Data":"1dfd2a257e9cc765e90ec4189d9d4fbafcfc29a8bb941eb951b5ec1c2c0b597d"}
Oct 30 14:06:39.440274 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.440197    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gfk9t" podStartSLOduration=1.778171132 podStartE2EDuration="4.440182764s" totalImagesPullingTime="2.662011632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:39.439859921 +0000 UTC m=+33.946320685" watchObservedRunningTime="2026-10-30 14:06:39.440182764 +0000 UTC m=+33.946643525"
Oct 30 14:06:39.781157 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.781080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:39.781157 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.781128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:39.781363 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:39.781234    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 14:06:39.781363 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:39.781325    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:07:11.78130937 +0000 UTC m=+66.287770111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : secret "metrics-daemon-secret" not found
Oct 30 14:06:39.783352 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.783327    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:39.794780 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.794756    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-85889"]
Oct 30 14:06:39.837305 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.837275    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-85889"]
Oct 30 14:06:39.837423 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.837343    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:39.866712 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.866687    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-sdd5w-49dtr"]
Oct 30 14:06:39.879802 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.879782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:39.881746 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.881722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:39.883972 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.883952    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:39.886292 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.886276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:39.892870 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.892851    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-sdd5w-49dtr"]
Oct 30 14:06:39.902163 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.902149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:39.904850 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.904826    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 14:06:39.904948 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.904876    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 14:06:39.904948 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.904891    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 14:06:39.904948 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.904921    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 14:06:39.905096 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.905079    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 14:06:39.905138 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.905127    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h2cvg\""
Oct 30 14:06:39.905178 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.905132    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g7grg\""
Oct 30 14:06:39.929625 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.929605    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 14:06:39.982771 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.982741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hms\" (UniqueName: \"kubernetes.io/projected/da4b95f0-1840-4912-b202-2e49232dfac9-kube-api-access-x6hms\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:39.982881 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.982787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:39.982881 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.982839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:39.982996 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.982976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:39.983053 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.983034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4b95f0-1840-4912-b202-2e49232dfac9-data-volume\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:39.983105 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.983088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:39.983155 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.983111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da4b95f0-1840-4912-b202-2e49232dfac9-crio-socket\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:39.983155 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.983137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:39.983258 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:39.983173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.083870 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.083842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.083874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.083897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4b95f0-1840-4912-b202-2e49232dfac9-data-volume\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.084000    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.084070    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:40.584051717 +0000 UTC m=+35.090512477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da4b95f0-1840-4912-b202-2e49232dfac9-crio-socket\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hms\" (UniqueName: \"kubernetes.io/projected/da4b95f0-1840-4912-b202-2e49232dfac9-kube-api-access-x6hms\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084183    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4b95f0-1840-4912-b202-2e49232dfac9-data-volume\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084226 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.084660 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.084281    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 14:06:40.084660 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084316    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da4b95f0-1840-4912-b202-2e49232dfac9-crio-socket\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.084660 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.084361    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:40.584341577 +0000 UTC m=+35.090802340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : configmap "kube-rbac-proxy" not found
Oct 30 14:06:40.084660 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084514    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.084828 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084690    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.084898 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.084883    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.107547 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.107519    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hms\" (UniqueName: \"kubernetes.io/projected/da4b95f0-1840-4912-b202-2e49232dfac9-kube-api-access-x6hms\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.107754 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.107736    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.199586 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.199561    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vbbts"]
Oct 30 14:06:40.204473 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:40.204451    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a21de7b_d2bd_4174_aee2_047a16242992.slice/crio-6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e WatchSource:0}: Error finding container 6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e: Status 404 returned error can't find the container with id 6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e
Oct 30 14:06:40.215881 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.215862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:40.239117 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.239094    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rksrm"]
Oct 30 14:06:40.243297 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:40.243272    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7245c5d9_0734_406c_a2bf_ff06c31c791a.slice/crio-3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250 WatchSource:0}: Error finding container 3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250: Status 404 returned error can't find the container with id 3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250
Oct 30 14:06:40.403019 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.402950    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rksrm" event={"ID":"7245c5d9-0734-406c-a2bf-ff06c31c791a","Type":"ContainerStarted","Data":"3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250"}
Oct 30 14:06:40.403990 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.403965    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vbbts" event={"ID":"2a21de7b-d2bd-4174-aee2-047a16242992","Type":"ContainerStarted","Data":"6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e"}
Oct 30 14:06:40.531102 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.531077    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-sdd5w-49dtr"]
Oct 30 14:06:40.535285 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:40.535261    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e7afaa_96e3_4842_b1f2_32d5d1e54e74.slice/crio-045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a WatchSource:0}: Error finding container 045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a: Status 404 returned error can't find the container with id 045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a
Oct 30 14:06:40.587909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.587888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.587983 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:40.587936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:40.588025 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.587999    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 14:06:40.588058 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.588052    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:41.588037469 +0000 UTC m=+36.094498220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : configmap "kube-rbac-proxy" not found
Oct 30 14:06:40.588173 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.588158    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:40.588223 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:40.588206    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:41.588192354 +0000 UTC m=+36.094653100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:41.134259 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.134219    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"]
Oct 30 14:06:41.160438 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.160410    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"]
Oct 30 14:06:41.160582 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.160501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:41.181054 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.181027    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 14:06:41.181229 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.181146    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4szpv\""
Oct 30 14:06:41.181229 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.181157    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 14:06:41.292774 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.292735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bplx6\" (UniqueName: \"kubernetes.io/projected/d37b2640-a448-415d-b601-45b9b25221d2-kube-api-access-bplx6\") pod \"migrator-66df5d496b-tl782\" (UID: \"d37b2640-a448-415d-b601-45b9b25221d2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:41.394259 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.394068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bplx6\" (UniqueName: \"kubernetes.io/projected/d37b2640-a448-415d-b601-45b9b25221d2-kube-api-access-bplx6\") pod \"migrator-66df5d496b-tl782\" (UID: \"d37b2640-a448-415d-b601-45b9b25221d2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:41.409265 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.409212    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sdd5w-49dtr" event={"ID":"36e7afaa-96e3-4842-b1f2-32d5d1e54e74","Type":"ContainerStarted","Data":"045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a"}
Oct 30 14:06:41.409496 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.409477    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-j4trr"]
Oct 30 14:06:41.426432 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.426403    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bplx6\" (UniqueName: \"kubernetes.io/projected/d37b2640-a448-415d-b601-45b9b25221d2-kube-api-access-bplx6\") pod \"migrator-66df5d496b-tl782\" (UID: \"d37b2640-a448-415d-b601-45b9b25221d2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:41.437933 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.437907    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-j4trr"]
Oct 30 14:06:41.438059 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.438005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.453315 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.453293    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 14:06:41.453417 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.453374    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 14:06:41.453485 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.453473    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4n4gw\""
Oct 30 14:06:41.453533 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.453520    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 14:06:41.453636 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.453622    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 14:06:41.489965 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.489940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:41.596928 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.596900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:41.597040 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.596946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-cabundle\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.597040 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.597016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-key\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.597116 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.597047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkpz9\" (UniqueName: \"kubernetes.io/projected/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-kube-api-access-xkpz9\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.597146 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.597130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:41.597313 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:41.597298    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:41.597374 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:41.597363    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:43.597344256 +0000 UTC m=+38.103805005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:41.597884 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:41.597861    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 14:06:41.597976 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:41.597927    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:43.597910234 +0000 UTC m=+38.104370978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : configmap "kube-rbac-proxy" not found
Oct 30 14:06:41.697845 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.697769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-cabundle\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.697845 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.697823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-key\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.698039 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.697852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkpz9\" (UniqueName: \"kubernetes.io/projected/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-kube-api-access-xkpz9\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.698717 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.698699    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-cabundle\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.701909 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.701861    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-key\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.725977 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.725916    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkpz9\" (UniqueName: \"kubernetes.io/projected/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-kube-api-access-xkpz9\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.765967 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.765777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:41.818794 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:41.818766    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"]
Oct 30 14:06:42.107696 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:42.107618    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-j4trr"]
Oct 30 14:06:42.110461 ip-10-0-132-7 kubenswrapper[2580]: W1030 14:06:42.110424    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode647d5bf_5715_4c76_b79f_4d6fb5469dd4.slice/crio-e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89 WatchSource:0}: Error finding container e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89: Status 404 returned error can't find the container with id e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89
Oct 30 14:06:42.414714 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:42.414625    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr" event={"ID":"e647d5bf-5715-4c76-b79f-4d6fb5469dd4","Type":"ContainerStarted","Data":"e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89"}
Oct 30 14:06:42.415888 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:42.415859    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782" event={"ID":"d37b2640-a448-415d-b601-45b9b25221d2","Type":"ContainerStarted","Data":"bc21938829f683cbfc375c07d38b16b99cd3f49eaecdb463129cbddb19abf078"}
Oct 30 14:06:43.109131 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:43.109090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:43.109318 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:43.109292    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:43.109378 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:43.109373    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:51.109351694 +0000 UTC m=+45.615812452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:43.613120 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:43.612823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:43.613120 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:43.612918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:43.613120 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:43.612977    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 14:06:43.613120 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:43.613044    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:43.613120 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:43.613059    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:47.613037409 +0000 UTC m=+42.119498162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : configmap "kube-rbac-proxy" not found
Oct 30 14:06:43.613120 ip-10-0-132-7 kubenswrapper[2580]: E1030 14:06:43.613095    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:47.613083383 +0000 UTC m=+42.119544139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:44.423837 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:44.423804    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sdd5w-49dtr" event={"ID":"36e7afaa-96e3-4842-b1f2-32d5d1e54e74","Type":"ContainerStarted","Data":"f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29"}
Oct 30 14:06:44.426841 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:44.426810    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782" event={"ID":"d37b2640-a448-415d-b601-45b9b25221d2","Type":"ContainerStarted","Data":"e40f3ba44083b264fd5c0affdc2f2672aa78064b058e4995d8a7dcbd21fb1979"}
Oct 30 14:06:44.472363 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:44.472307    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-sdd5w-49dtr" podStartSLOduration=2.307851012 podStartE2EDuration="5.472294014s" totalImagesPullingTime="3.164443002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:44.471456381 +0000 UTC m=+38.977917133" watchObservedRunningTime="2026-10-30 14:06:44.472294014 +0000 UTC m=+38.978754777"
Oct 30 14:06:45.431697 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:45.431657    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rksrm" event={"ID":"7245c5d9-0734-406c-a2bf-ff06c31c791a","Type":"ContainerStarted","Data":"a08be7bbea6cbb42012134c59d03e1ba986378bd9777a546f7a23b3e627df6fd"}
Oct 30 14:06:45.432356 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:45.432337    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:45.434097 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:45.434065    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr" event={"ID":"e647d5bf-5715-4c76-b79f-4d6fb5469dd4","Type":"ContainerStarted","Data":"105240fab80f817458a5df049f1f3547653443d9575e5ec0ffa67b3fe461061c"}
Oct 30 14:06:45.473540 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:45.473485    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782" podStartSLOduration=2.605242274 podStartE2EDuration="4.473468727s" totalImagesPullingTime="1.868226453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:44.51905282 +0000 UTC m=+39.025513584" watchObservedRunningTime="2026-10-30 14:06:45.473468727 +0000 UTC m=+39.979929492"
Oct 30 14:06:45.515079 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:45.514997    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr" podStartSLOduration=1.373907645 podStartE2EDuration="4.514984367s" totalImagesPullingTime="3.141076722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:45.514494868 +0000 UTC m=+40.020955634" watchObservedRunningTime="2026-10-30 14:06:45.514984367 +0000 UTC m=+40.021445159"
Oct 30 14:06:45.515443 ip-10-0-132-7 kubenswrapper[2580]: I1030 14:06:45.515414    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rksrm" podStartSLOduration=35.241624638 podStartE2EDuration="39.515403768s" totalImagesPullingTime="4.27377913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:45.473293751 +0000 UTC m=+39.979754516" watchObservedRunningTime="2026-10-30 14:06:45.515403768 +0000 UTC m=+40.021864533"
Oct 30 14:06:46.293446 ip-10-0-132-7 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 14:06:46.300777 ip-10-0-132-7 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 14:06:46.300946 ip-10-0-132-7 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 14:06:46.300993 ip-10-0-132-7 systemd[1]: kubelet.service: Consumed 2.321s CPU time.
Oct 30 14:06:46.315870 ip-10-0-132-7 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 14:06:46.430158 ip-10-0-132-7 kubenswrapper[4538]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 14:06:46.430698 ip-10-0-132-7 kubenswrapper[4538]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 14:06:46.430698 ip-10-0-132-7 kubenswrapper[4538]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 14:06:46.430698 ip-10-0-132-7 kubenswrapper[4538]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 14:06:46.432806 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432724    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.432806 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432802    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.432806 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432810    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432816    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432820    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432825    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432829    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432833    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432837    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432840    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432844    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432849    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432853    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432857    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432861    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432865    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432869    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432873    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432877    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432881    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432885    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432889    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.433018 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432893    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432897    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432901    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432905    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432909    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432919    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432924    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432928    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432933    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432937    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432942    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432946    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432951    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432956    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432960    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432965    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432969    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432974    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432978    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432982    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.433901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432987    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432992    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.432996    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433001    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433005    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433010    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433014    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433019    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433023    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433027    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433034    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433040    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433046    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433050    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433056    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433061    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433065    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433069    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433075    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.434768 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433079    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433084    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433088    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433093    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433097    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433101    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433107    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433111    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433116    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433120    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433124    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433129    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433134    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433138    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433144    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433149    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433153    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433158    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433162    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.435603 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433167    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433171    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433177    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433182    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433186    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433191    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433195    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433200    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433205    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433210    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433214    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433218    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433223    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433228    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433232    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433237    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433281    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433287    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433292    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433296    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.436449 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433300    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433304    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433309    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433313    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433318    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.433322    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434656    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434669    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434675    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434680    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434685    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434691    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434696    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434700    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434705    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434709    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434713    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434718    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434722    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434726    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.437351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434730    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434735    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434740    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434745    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434749    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434753    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434758    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434763    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434767    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434772    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434776    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434780    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434784    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434789    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434793    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434798    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434803    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434807    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434811    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.438276 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434816    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434820    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434825    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434829    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434833    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434837    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434841    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434846    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434850    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434854    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434859    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434863    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434867    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434871    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434875    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434882    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434889    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434894    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434898    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.439107 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434903    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434908    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434913    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434917    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434921    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434925    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434930    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434934    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434939    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434944    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434948    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434952    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434957    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434961    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434966    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434971    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434975    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434980    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434984    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434988    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.439733 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434993    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.434997    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435001    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435005    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435009    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435013    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435018    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435022    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435027    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435031    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435035    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435043    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435047    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435054    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435063    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435067    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435072    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435076    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435081    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.440213 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435085    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435090    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435094    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435098    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435103    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435107    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435111    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435116    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435120    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435124    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435129    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435133    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435137    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435141    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.435147    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436071    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436082    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436087    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436091    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436096    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.440700 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436100    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436105    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436109    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436114    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436119    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436124    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436128    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436134    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436138    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436142    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436147    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436151    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436155    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436159    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436164    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436169    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436173    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436177    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436182    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436187    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.441174 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436191    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436195    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436200    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436204    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436208    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436212    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436216    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436221    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436226    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436230    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436234    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436238    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436266    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436271    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436275    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436280    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436284    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436289    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436293    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436298    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.441688 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436303    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436307    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436312    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436316    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436321    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436325    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436329    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436334    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436341    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436348    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436354    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436359    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436363    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436368    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436372    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436377    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436381    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436385    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436390    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.442147 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436394    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436401    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436405    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436410    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436414    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436419    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436423    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436428    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436432    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436437    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436441    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436445    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436449    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436453    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436460    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436464    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436468    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436472    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436477    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436481    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.442730 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436486    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436490    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436494    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436500    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436506    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436510    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436515    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436519    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436523    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436527    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436532    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436536    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436540    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436547    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436552    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436556    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436560    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436564    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436569    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.443354 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436573    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436580    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.436585    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436718    4538 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436730    4538 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436740    4538 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436747    4538 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436754    4538 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436764    4538 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436771    4538 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436778    4538 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436783    4538 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436788    4538 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436794    4538 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436799    4538 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436804    4538 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436809    4538 flags.go:64] FLAG: --cgroup-root=""
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436814    4538 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436819    4538 flags.go:64] FLAG: --client-ca-file=""
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436824    4538 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436829    4538 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436835    4538 flags.go:64] FLAG: --cluster-domain=""
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436839    4538 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436844    4538 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 14:06:46.443823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436849    4538 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436855    4538 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436863    4538 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436868    4538 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436874    4538 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436879    4538 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436883    4538 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436888    4538 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436893    4538 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436902    4538 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436907    4538 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436913    4538 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436918    4538 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436923    4538 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436928    4538 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436933    4538 flags.go:64] FLAG: --enable-server="true"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436938    4538 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436946    4538 flags.go:64] FLAG: --event-burst="100"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436952    4538 flags.go:64] FLAG: --event-qps="50"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436956    4538 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436961    4538 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436966    4538 flags.go:64] FLAG: --eviction-hard=""
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436973    4538 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436977    4538 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436982    4538 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 14:06:46.444735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436988    4538 flags.go:64] FLAG: --eviction-soft=""
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436993    4538 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.436998    4538 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437003    4538 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437008    4538 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437013    4538 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437018    4538 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437022    4538 flags.go:64] FLAG: --feature-gates=""
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437029    4538 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437036    4538 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437041    4538 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437046    4538 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437051    4538 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437056    4538 flags.go:64] FLAG: --help="false"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437061    4538 flags.go:64] FLAG: --hostname-override="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437066    4538 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437072    4538 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437078    4538 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437083    4538 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437089    4538 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437094    4538 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437098    4538 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437103    4538 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 14:06:46.445781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437108    4538 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437113    4538 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437119    4538 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437124    4538 flags.go:64] FLAG: --kube-reserved=""
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437129    4538 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437134    4538 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437139    4538 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437143    4538 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437148    4538 flags.go:64] FLAG: --lock-file=""
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437153    4538 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437157    4538 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437162    4538 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437171    4538 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437176    4538 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437181    4538 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437185    4538 flags.go:64] FLAG: --logging-format="text"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437190    4538 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437196    4538 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437203    4538 flags.go:64] FLAG: --manifest-url=""
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437209    4538 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437215    4538 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437220    4538 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437226    4538 flags.go:64] FLAG: --max-pods="110"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437231    4538 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437236    4538 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 14:06:46.446765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437258    4538 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437264    4538 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437269    4538 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437274    4538 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437279    4538 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437290    4538 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437295    4538 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437300    4538 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437305    4538 flags.go:64] FLAG: --pod-cidr=""
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437310    4538 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437317    4538 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437322    4538 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437327    4538 flags.go:64] FLAG: --port="10250"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437332    4538 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437337    4538 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2d6e251c50af9dc"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437342    4538 flags.go:64] FLAG: --qos-reserved=""
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437347    4538 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437352    4538 flags.go:64] FLAG: --register-node="true"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437356    4538 flags.go:64] FLAG: --register-with-taints=""
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437365    4538 flags.go:64] FLAG: --registry-burst="10"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437370    4538 flags.go:64] FLAG: --registry-qps="5"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437375    4538 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437379    4538 flags.go:64] FLAG: --reserved-memory=""
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437386    4538 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437391    4538 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437396    4538 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 14:06:46.447430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437401    4538 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437406    4538 flags.go:64] FLAG: --runonce="false"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437411    4538 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437416    4538 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437421    4538 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437426    4538 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437433    4538 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437438    4538 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437443    4538 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437448    4538 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437452    4538 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437457    4538 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437462    4538 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437467    4538 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437472    4538 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437477    4538 flags.go:64] FLAG: --system-cgroups=""
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437482    4538 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437491    4538 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437497    4538 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437501    4538 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437508    4538 flags.go:64] FLAG: --tls-min-version=""
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437513    4538 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437518    4538 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437523    4538 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437527    4538 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 14:06:46.448044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437532    4538 flags.go:64] FLAG: --v="2"
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437539    4538 flags.go:64] FLAG: --version="false"
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437546    4538 flags.go:64] FLAG: --vmodule=""
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437552    4538 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.437557    4538 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437758    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437764    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437769    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437773    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437777    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437782    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437786    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437790    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437798    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437802    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437806    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437811    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437815    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437820    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437824    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437828    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.448697 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437832    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437837    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437841    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437846    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437851    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437855    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437860    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437864    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437868    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437873    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437877    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437882    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437886    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437891    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437895    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437899    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437903    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437908    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437912    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.449265 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437916    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437920    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437925    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437931    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437937    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437945    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437950    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437955    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437959    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437963    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437968    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.437973    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438000    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438006    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438011    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438015    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438020    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438025    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438033    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.449789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438039    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438044    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438048    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438052    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438057    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438061    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438065    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438070    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438074    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438078    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438082    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438086    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438090    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438095    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438100    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438106    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438111    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438115    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438121    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438126    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.450238 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438130    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438136    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438140    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438145    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438149    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438154    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438158    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438162    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438167    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438171    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438176    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438180    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438185    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438190    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438194    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438198    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438202    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438207    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438211    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.450740 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438215    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438220    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438224    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438229    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438233    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438237    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438258    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438262    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438267    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438271    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438275    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438281    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438285    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.438328    4538 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438383    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438391    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.451299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438396    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438401    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438406    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438410    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438414    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438418    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438423    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438427    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438431    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438435    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438441    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438445    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438450    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438455    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438459    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438463    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438468    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438472    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438477    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438481    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.451757 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438485    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438490    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438495    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438499    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438504    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438508    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438513    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438519    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438523    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438527    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438532    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438538    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438545    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438550    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438555    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438560    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438565    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438569    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438574    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438578    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.452321 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438583    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438587    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438591    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438596    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438601    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438606    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438610    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438617    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438625    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438629    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438634    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438638    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438643    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438648    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438653    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438658    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438664    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438668    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438673    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.452820 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438678    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438683    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438687    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438691    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438697    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438702    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438706    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438711    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438715    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438719    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438724    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438728    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438732    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438736    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438741    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438746    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438750    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438756    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438761    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438765    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.453464 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438769    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438773    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438777    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438781    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438786    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438790    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438795    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438799    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438803    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438807    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438811    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438816    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438821    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438826    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438830    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438834    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438840    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438844    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438848    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.454187 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438852    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438856    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438861    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438865    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438870    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.438874    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.447199    4538 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.447217    4538 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.447241    4538 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.447268    4538 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447349    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447356    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447361    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447366    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447371    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447375    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447379    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447383    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447388    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447392    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.454913 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447396    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447401    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447405    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447409    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447414    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447418    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447422    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447426    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447430    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447435    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447440    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447444    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447449    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447460    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447464    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447469    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447473    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447478    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447482    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447486    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.455861 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447490    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447495    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447499    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447503    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447507    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447512    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447516    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447520    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447524    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447528    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447532    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447537    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447541    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447545    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447550    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447554    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447559    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447563    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447568    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.456491 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447572    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447576    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447580    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447584    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447589    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447593    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447597    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447602    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447606    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447610    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447615    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447619    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447623    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447628    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447632    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447638    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447644    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447649    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447654    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447658    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.456961 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447663    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447667    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447671    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447675    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447679    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447683    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447688    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447694    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447700    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447705    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447710    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447715    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447719    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447723    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447727    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447731    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447735    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447739    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447744    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.457515 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447748    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447752    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447757    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447762    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447766    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447770    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447774    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447778    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447782    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447786    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447790    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447795    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447798    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447802    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447806    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447811    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447815    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.458079 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.447819    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.447857    4538 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448056    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448064    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448068    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448073    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448077    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448082    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448087    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448091    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448095    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448100    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448104    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448108    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448112    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448116    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.458618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448120    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448125    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448129    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448134    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448138    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448142    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448146    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448150    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448154    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448158    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448162    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448166    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448170    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448175    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448179    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448183    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448187    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448191    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448195    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.459175 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448199    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448203    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448207    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448211    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448215    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448220    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448224    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448228    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448232    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448236    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448240    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448259    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448264    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448269    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448273    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448277    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448281    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448286    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448289    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.460099 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448294    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448298    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448302    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448306    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448311    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448315    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448319    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448324    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448328    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448332    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448336    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448341    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448346    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448350    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448354    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448359    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448363    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448367    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448371    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448376    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.460920 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448381    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448386    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448390    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448394    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448399    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448403    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448407    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448411    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448415    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448419    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448423    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448427    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448431    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448435    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448439    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448442    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448449    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448454    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448459    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.461710 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448463    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448467    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448472    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448476    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448481    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448486    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448490    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448494    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448499    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448503    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448507    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448514    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448519    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448525    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448529    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.462553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.448564    4538 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448611    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448619    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448623    4538 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448628    4538 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448632    4538 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448636    4538 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448640    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448645    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448652    4538 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448658    4538 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448663    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448668    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448672    4538 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448676    4538 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448684    4538 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448688    4538 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448692    4538 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448696    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 14:06:46.463226 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448701    4538 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448705    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448710    4538 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448714    4538 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448719    4538 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448723    4538 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448727    4538 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448731    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448736    4538 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448740    4538 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448744    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448749    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448753    4538 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448758    4538 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448762    4538 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448766    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448770    4538 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448774    4538 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448778    4538 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 14:06:46.464034 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448783    4538 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448787    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448791    4538 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448795    4538 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448799    4538 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448803    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448807    4538 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448811    4538 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448816    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448821    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448825    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448829    4538 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448833    4538 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448838    4538 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448842    4538 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448846    4538 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448850    4538 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448854    4538 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448858    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448863    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 14:06:46.464865 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448867    4538 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448871    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448875    4538 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448879    4538 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448884    4538 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448888    4538 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448893    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448897    4538 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448902    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448907    4538 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448911    4538 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448915    4538 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448919    4538 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448924    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448928    4538 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448932    4538 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448936    4538 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448940    4538 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448945    4538 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448949    4538 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 14:06:46.465813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448954    4538 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448958    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448962    4538 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448966    4538 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448970    4538 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448974    4538 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448979    4538 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448983    4538 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448987    4538 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448991    4538 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.448996    4538 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449000    4538 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449004    4538 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449008    4538 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449012    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449016    4538 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449020    4538 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449024    4538 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449028    4538 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449033    4538 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 14:06:46.466684 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449038    4538 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449042    4538 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449046    4538 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449053    4538 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449059    4538 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449065    4538 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449095    4538 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449101    4538 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:46.449106    4538 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.449177    4538 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.450662    4538 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.450742    4538 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.450978    4538 server.go:1014] "Starting client certificate rotation"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.451135    4538 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.451186    4538 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 14:01:06 +0000 UTC" deadline="2028-06-02 12:57:05.303450688 +0000 UTC"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.451225    4538 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13942h50m18.852229015s"
Oct 30 14:06:46.467608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.451738    4538 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 14:06:46.468408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.453221    4538 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 14:06:46.468408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.454940    4538 log.go:25] "Validated CRI v1 runtime API"
Oct 30 14:06:46.468408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.457425    4538 log.go:25] "Validated CRI v1 image API"
Oct 30 14:06:46.468408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.458314    4538 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 14:06:46.468408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.460639    4538 fs.go:135] Filesystem UUIDs: map[12963897-6158-4556-9965-972a993d3e6c:/dev/nvme0n1p4 30bf16de-95ac-4d79-9cb8-4d54f51780dc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 14:06:46.468662 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.460663    4538 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bc21938829f683cbfc375c07d38b16b99cd3f49eaecdb463129cbddb19abf078/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bc21938829f683cbfc375c07d38b16b99cd3f49eaecdb463129cbddb19abf078/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d914a5b06804a35e95f2c18d03b418f3d0a60e5d5616ee30b179f64620c7de7c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d914a5b06804a35e95f2c18d03b418f3d0a60e5d5616ee30b179f64620c7de7c/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7/volumes/kubernetes.io~projected/kube-api-access-j9kxq:{mountpoint:/var/lib/kubelet/pods/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7/volumes/kubernetes.io~projected/kube-api-access-j9kxq major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a21de7b-d2bd-4174-aee2-047a16242992/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/2a21de7b-d2bd-4174-aee2-047a16242992/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/365c35a5-ff31-4e62-82bc-da9d408a4ff0/volumes/kubernetes.io~projected/kube-api-access-hhjfx:{mountpoint:/var/lib/kubelet/pods/365c35a5-ff31-4e62-82bc-da9d408a4ff0/volumes/kubernetes.io~projected/kube-api-access-hhjfx major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36e7afaa-96e3-4842-b1f2-32d5d1e54e74/volumes/kubernetes.io~projected/kube-api-access-6f9d5:{mountpoint:/var/lib/kubelet/pods/36e7afaa-96e3-4842-b1f2-32d5d1e54e74/volumes/kubernetes.io~projected/kube-api-access-6f9d5 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62ce59d3-403d-403e-b150-805154000f23/volumes/kubernetes.io~projected/kube-api-access-bgqb9:{mountpoint:/var/lib/kubelet/pods/62ce59d3-403d-403e-b150-805154000f23/volumes/kubernetes.io~projected/kube-api-access-bgqb9 major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62ce59d3-403d-403e-b150-805154000f23/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/62ce59d3-403d-403e-b150-805154000f23/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/67223fe5-9de3-4a9d-ad37-d7f1735bf0de/volumes/kubernetes.io~projected/kube-api-access-rn8t5:{mountpoint:/var/lib/kubelet/pods/67223fe5-9de3-4a9d-ad37-d7f1735bf0de/volumes/kubernetes.io~projected/kube-api-access-rn8t5 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7245c5d9-0734-406c-a2bf-ff06c31c791a/volumes/kubernetes.io~projected/kube-api-access-j8v2n:{mountpoint:/var/lib/kubelet/pods/7245c5d9-0734-406c-a2bf-ff06c31c791a/volumes/kubernetes.io~projected/kube-api-access-j8v2n major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9660c039-cb78-44b3-a886-63c1dd6a93d8/volumes/kubernetes.io~projected/kube-api-access-cvlrz:{mountpoint:/var/lib/kubelet/pods/9660c039-cb78-44b3-a886-63c1dd6a93d8/volumes/kubernetes.io~projected/kube-api-access-cvlrz major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bbb4015f-b6ef-4a06-8184-4212485732d5/volumes/kubernetes.io~projected/kube-api-access-9bvwl:{mountpoint:/var/lib/kubelet/pods/bbb4015f-b6ef-4a06-8184-4212485732d5/volumes/kubernetes.io~projected/kube-api-access-9bvwl major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8815fb-55ec-4632-aa1e-aa519da33bd2/volumes/kubernetes.io~projected/kube-api-access-hqh2q:{mountpoint:/var/lib/kubelet/pods/bd8815fb-55ec-4632-aa1e-aa519da33bd2/volumes/kubernetes.io~projected/kube-api-access-hqh2q major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d37b2640-a448-415d-b601-45b9b25221d2/volumes/kubernetes.io~projected/kube-api-access-bplx6:{mountpoint:/var/lib/kubelet/pods/d37b2640-a448-415d-b601-45b9b25221d2/volumes/kubernetes.io~projected/kube-api-access-bplx6 major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/da4b95f0-1840-4912-b202-2e49232dfac9/volumes/kubernetes.io~projected/kube-api-access-x6hms:{mountpoint:/var/lib/kubelet/pods/da4b95f0-1840-4912-b202-2e49232dfac9/volumes/kubernetes.io~projected/kube-api-access-x6hms major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volumes/kubernetes.io~projected/kube-api-access-8ffzk:{mountpoint:/var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volumes/kubernetes.io~projected/kube-api-access-8ffzk major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5e38e39-299e-4d1f-ab21-aed0321cf7b1/volumes/kubernetes.io~projected/kube-api-access-m8zf6:{mountpoint:/var/lib/kubelet/pods/e5e38e39-299e-4d1f-ab21-aed0321cf7b1/volumes/kubernetes.io~projected/kube-api-access-m8zf6 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e647d5bf-5715-4c76-b79f-4d6fb5469dd4/volumes/kubernetes.io~projected/kube-api-access-xkpz9:{mountpoint:/var/lib/kubelet/pods/e647d5bf-5715-4c76-b79f-4d6fb5469dd4/volumes/kubernetes.io~projected/kube-api-access-xkpz9 major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e647d5bf-5715-4c76-b79f-4d6fb5469dd4/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/e647d5bf-5715-4c76-b79f-4d6fb5469dd4/volumes/kubernetes.io~secret/signing-key major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~projected/kube-api-access-4jn5m:{mountpoint:/var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~projected/kube-api-access-4jn5m major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee1ea063-3567-4b9e-a55f-ecea343bc7f0/volumes/kubernetes.io~projected/kube-api-access-2bbfg:{mountpoint:/var/lib/kubelet/pods/ee1ea063-3567-4b9e-a55f-ecea343bc7f0/volumes/kubernetes.io~projected/kube-api-access-2bbfg major:0 minor:60 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/98e4bd8d478136dd03de6a566843da58451924eadd082bb3b67bc196540e1d04/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/387d1e38558069aa5cf1e6fbd902a4ad621f5b212e54f40a31a415ce825e76ee/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/6b1a6762cd21289fb0c3fbd926b468a8dacb2db9dba8153b011d750209e04ae0/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/8e5f5007252251cb2b350f101fe0459e63a4fea51de852464075dfc680fa1230/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/3169fe326785133ac565f36c5425fed61cffe6695ff004b9a8d52a14049bc9fa/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/94c53bd15a9c648a67a87683da04f84ec2748cbf7692acb28b9faf6a0d939ea2/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/4949369d501ae2a79aace4a8c4dab82a35318892c1935693e7fcdf6f0386c0fe/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/67c411467267161d988f78a5c455ca6a3fd9da52a72a8244cf4b34f8055a8fff/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/4c51dbb961b1f7be90875e6882fbed5099259d3058b41958f7dbe52548d01ade/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/9e009149c4313343725a82048deef8d242686c5ad377a2e3da13d26151e98795/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/ead17af72db83c04798099a76ae493a56eabadf077dc682881fe05725357ccd4/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/8ab98c0d757131a9f2fdc2b0b91c0f3b0a045976c81175b67d1102d46ce9749f/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/6aec60412ec92c68c68fab8a769feb9f82f87b08fcdcdbdd2ddf85ede9da80b0/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/11999f6aba55dbd062cc424dda25d276a0ccc39675b098028d014c2ea6198aad/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/5da461cad31a6d5ac48c07a4eca5344feef28ff640951efa22bfa8231794a215/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/9f5567544b0d20a13256f0aeb73bca3168a7ad77f14c6dba1f904d0e31e0035f/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/6b43ae015ed8361046047453cd6bd7a6cd44e3e922b4e2dfe0d7d7928cac78ac/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/6a2c18d76100ec2cccc4a0d683b6ccbd7cf04fd6e0f14ed18f4c40bc7fe3d31c/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/4518287efccb8237f2dcc906a0d7bfe5b7f46a3b7048686e6738d8c2206b1a0c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/16a6e7b032e5d3c8b9e5ef38ee7c4f51179cd9eddd4cf47e5aa123dcd2347515/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f9976704ae77202482a0b581121d9a1b8d61e99617852e508e68628caa70ba5d/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/c9b12cd576cfb7d649af801e67aa75eea65783bdbd3d4177725f28245de1872c/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/475159a6755f771cf1d559347708410f6ea80be89dfe8c8a10da5baab87c3933/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/4a50afc1be15bef3560cfab7999d4c0a871e72aaa99ed79156a805d9b8444b4d/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/e32817817bba59d0a7a7ad601f6ec1ab6a48f8e44d3e4ba485eef35239df3447/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/0fce5e1b86e5161e840cd21f49c038e669d2d1ed8abc7c74baead53160b8cb84/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/08255d2947c5bae0dd60b17c055e6b59edc4804101550ae1efa6de2cd63dc8d9/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/fa7721bb69d3e501e13f2dc8362e54e07354ce1d438203f325afe2d5d6152aa3/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/241eafec06da4dd0387f6dcdc92882f34fb63942ef74676525834fc80d3c61c9/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/5fe98e211702e92bae0e6f91820af0bb37721eec449895730140fbc7572b9def/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/bcab9fd38a7fd6ee20ceffdfa16b5eb80f5ed1ac21f240dcb1142328ebeda3eb/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/fd3ed28865bea644846ae67f58698afdeb5fa35959e7733a0904789803d7775e/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/0e408b611ba5a0a22945bbb5b84b0b2862c7c51960d8df9e316a192940aad8ed/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/7a7413e035dc2c16beb5ecdff982cb5c908921899cf7ef56ca9c41f41bfd04a4/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/02853aeab7f12b6ded03f1c95328a97f6cac6f0cc5132d888a1353ea663a48e2/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/70edf48b81f8fb9bbaeccff4f975bde582e44f21986d0621bf46728bc0806f52/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/1b455423344774ad0b95e73d877f241e0bf6ef1d79d385964a5ee7676ba1e3b5/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/eb2ed09fba4fd091783bfc00221cfdd7b5f86346786bee567cfe623696b79a00/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/27653b48a90e12467e642234d8705731996615ffeac50481b0f11af27449f77c/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-85:{mountpoint:/var/lib/containers/storage/overlay/d12c86b748949b22541ab7ff9562c2735da8ca6cdc9612e558cb6b31151f9dd1/merged major:0 minor:85 fsType:overlay blockSize:0} overlay_0-89:{mountpoint:/var/lib/containers/storage/overlay/aef083159d2f1714a44012ee7e3861c004ae361f14e0313c2f78f72f373a9fb9/merged major:0 minor:89 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/99f66810fb3e93315b3d7395eca66a1e9b105fc9e86deceac52f57d5bead9114/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/febcf444fbd04141b9219fc234299a6fe56198302fdea9133ff7026aea3a4ad1/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 14:06:46.470389 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.469981    4538 manager.go:217] Machine: {Timestamp:2026-10-30 14:06:46.469525655 +0000 UTC m=+0.104472269 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099983 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28d26195da4e2c9dda5616b486ee6b SystemUUID:ec28d261-95da-4e2c-9dda-5616b486ee6b BootID:31668288-efd1-4b6e-8285-5164eb40513b Filesystems:[{Device:/var/lib/kubelet/pods/67223fe5-9de3-4a9d-ad37-d7f1735bf0de/volumes/kubernetes.io~projected/kube-api-access-rn8t5 DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7245c5d9-0734-406c-a2bf-ff06c31c791a/volumes/kubernetes.io~projected/kube-api-access-j8v2n DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ee1ea063-3567-4b9e-a55f-ecea343bc7f0/volumes/kubernetes.io~projected/kube-api-access-2bbfg DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bbb4015f-b6ef-4a06-8184-4212485732d5/volumes/kubernetes.io~projected/kube-api-access-9bvwl DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d914a5b06804a35e95f2c18d03b418f3d0a60e5d5616ee30b179f64620c7de7c/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e42962ac91d50fed00e5f8585418cfda333df3ac0fb5084fe4f76e410c019a89/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f77cb6827ad9f2e5d3cbbe2dd484a22a9354d59795c15e0fec6acb14dc760309/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-89 DeviceMajor:0 DeviceMinor:89 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6200049e12813620e9d746a8458b0c2d862633864327224a270681ba93d83f3e/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bc21938829f683cbfc375c07d38b16b99cd3f49eaecdb463129cbddb19abf078/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/365c35a5-ff31-4e62-82bc-da9d408a4ff0/volumes/kubernetes.io~projected/kube-api-access-hhjfx DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volumes/kubernetes.io~projected/kube-api-access-8ffzk DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/48aa79e6edfa40dc31498e679dd6be72114fe7a213a9abe95599e2b7b4e3e3fa/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/62ce59d3-403d-403e-b150-805154000f23/volumes/kubernetes.io~projected/kube-api-access-bgqb9 DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d37b2640-a448-415d-b601-45b9b25221d2/volumes/kubernetes.io~projected/kube-api-access-bplx6 DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e647d5bf-5715-4c76-b79f-4d6fb5469dd4/volumes/kubernetes.io~projected/kube-api-access-xkpz9 DeviceMajor:0 DeviceMinor:232 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/807cb623b8ace41f6f068882b77c5afc562bd7fb7f69f202bbd7a78e3cd99564/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7675b45c3b9604d21470eba748cebc5daad3c16a988e22cbb0cc0955573a5823/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-85 DeviceMajor:0 DeviceMinor:85 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/62ce59d3-403d-403e-b150-805154000f23/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3f63f2980f47067d8adeac1f8a42fe8c08c39c5fb4317ae8160688e767798250/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/da4b95f0-1840-4912-b202-2e49232dfac9/volumes/kubernetes.io~projected/kube-api-access-x6hms DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e647d5bf-5715-4c76-b79f-4d6fb5469dd4/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e0fe9083-f455-4f5f-a452-37d368be1769/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/36e7afaa-96e3-4842-b1f2-32d5d1e54e74/volumes/kubernetes.io~projected/kube-api-access-6f9d5 DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7/volumes/kubernetes.io~projected/kube-api-access-j9kxq DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a21de7b-d2bd-4174-aee2-047a16242992/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c38aa450537ff7d7ea63e5038dcf9e2a2491e55f5d0f7f4ba7c7363d19ab239/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4aa34d346894889a44405c962eaf950f42bda2db55098835ecb15dd883e88812/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~projected/kube-api-access-4jn5m DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9660c039-cb78-44b3-a886-63c1dd6a93d8/volumes/kubernetes.io~projected/kube-api-access-cvlrz DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eb803507-7db8-4e13-9205-d7b10b8ed945/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8815fb-55ec-4632-aa1e-aa519da33bd2/volumes/kubernetes.io~projected/kube-api-access-hqh2q DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e5e38e39-299e-4d1f-ab21-aed0321cf7b1/volumes/kubernetes.io~projected/kube-api-access-m8zf6 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/959106d61d216ebe9c374062b9cbf3110282e3ff1c7043860c706c5427306dd0/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b8e983fd58810959c46aebd0cecf296d4d12e9132a6904a2689e31e22b28b76/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:045638be3eff3c7 MacAddress:c6:67:93:fb:e6:16 Speed:10000 Mtu:8901} {Name:3f63f2980f47067 MacAddress:2e:9d:67:83:49:4e Speed:10000 Mtu:8901} {Name:6200049e1281362 MacAddress:ae:57:92:6c:2f:80 Speed:10000 Mtu:8901} {Name:bc21938829f683c MacAddress:ee:57:bf:a4:c4:f4 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:fc:79:61:25 Speed:0 Mtu:9001} {Name:br-int MacAddress:26:e3:55:8b:7e:2f Speed:0 Mtu:8901} {Name:e42962ac91d50fe MacAddress:42:41:90:7c:53:18 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:fc:79:61:25 Speed:0 Mtu:9001} {Name:f77cb6827ad9f2e MacAddress:2e:c2:80:2d:8f:48 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:6a:9c:b0:68:f8:3d Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:be:c2:1f:c1:91:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 14:06:46.470635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.470391    4538 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 14:06:46.470635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.470452    4538 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 14:06:46.470759 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.470732    4538 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 14:06:46.470978 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.470762    4538 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 14:06:46.471063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.470982    4538 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 14:06:46.471063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.470995    4538 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 14:06:46.471063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471010    4538 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 14:06:46.471063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471038    4538 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 14:06:46.471234 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471138    4538 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 14:06:46.471679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471665    4538 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 14:06:46.471811 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471800    4538 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 14:06:46.471866 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471847    4538 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 14:06:46.471866 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471861    4538 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 14:06:46.471949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471874    4538 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 14:06:46.471949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471887    4538 kubelet.go:405] "Adding apiserver pod source"
Oct 30 14:06:46.471949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.471898    4538 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 14:06:46.472655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.472581    4538 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 14:06:46.472655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.472599    4538 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 14:06:46.473122 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.473102    4538 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 14:06:46.475516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.475499    4538 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 14:06:46.475516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.475513    4538 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 14:06:46.475652 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.475639    4538 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 14:06:46.475846 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.475831    4538 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 14:06:46.475922 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.475873    4538 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 14:06:46.475999 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.475988    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 14:06:46.476054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476007    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 14:06:46.476054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476017    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 14:06:46.476054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476036    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 14:06:46.476054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476046    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 14:06:46.476054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476055    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476065    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476074    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476086    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476104    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476123    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476138    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476177    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 14:06:46.476323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.476188    4538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 14:06:46.481043 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.479724    4538 server.go:1263] "Started kubelet"
Oct 30 14:06:46.480213 ip-10-0-132-7 systemd[1]: Started Kubernetes Kubelet.
Oct 30 14:06:46.482177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.481443    4538 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 14:06:46.482177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.481510    4538 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 14:06:46.482177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.481740    4538 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 14:06:46.482177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.482091    4538 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 14:06:46.485273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.484265    4538 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 14:06:46.485273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.484413    4538 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:46.485457    4538 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-7.ec2.internal\" not found"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.485501    4538 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.485509    4538 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.485703    4538 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487231    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67223fe5-9de3-4a9d-ad37-d7f1735bf0de" volumeName="kubernetes.io/projected/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-kube-api-access-rn8t5" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487285    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bbb4015f-b6ef-4a06-8184-4212485732d5" volumeName="kubernetes.io/projected/bbb4015f-b6ef-4a06-8184-4212485732d5-kube-api-access-9bvwl" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487299    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7" volumeName="kubernetes.io/empty-dir/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-tmp-dir" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487312    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" volumeName="kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487324    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" volumeName="kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487336    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67223fe5-9de3-4a9d-ad37-d7f1735bf0de" volumeName="kubernetes.io/empty-dir/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-tmp-dir" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487346    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d37b2640-a448-415d-b601-45b9b25221d2" volumeName="kubernetes.io/projected/d37b2640-a448-415d-b601-45b9b25221d2-kube-api-access-bplx6" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487357    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da4b95f0-1840-4912-b202-2e49232dfac9" volumeName="kubernetes.io/empty-dir/da4b95f0-1840-4912-b202-2e49232dfac9-data-volume" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487372    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0fe9083-f455-4f5f-a452-37d368be1769" volumeName="kubernetes.io/secret/e0fe9083-f455-4f5f-a452-37d368be1769-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487383    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb803507-7db8-4e13-9205-d7b10b8ed945" volumeName="kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-tmp" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487395    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4fbb0acc-a13c-4ca6-b00f-69e4c03eca15" volumeName="kubernetes.io/configmap/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-konnectivity-ca" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487407    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4fbb0acc-a13c-4ca6-b00f-69e4c03eca15" volumeName="kubernetes.io/secret/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-agent-certs" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487417    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9660c039-cb78-44b3-a886-63c1dd6a93d8" volumeName="kubernetes.io/configmap/9660c039-cb78-44b3-a886-63c1dd6a93d8-iptables-alerter-script" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487429    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0fe9083-f455-4f5f-a452-37d368be1769" volumeName="kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-config" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487443    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0fe9083-f455-4f5f-a452-37d368be1769" volumeName="kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-env-overrides" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487462    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5e38e39-299e-4d1f-ab21-aed0321cf7b1" volumeName="kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cni-binary-copy" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487474    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb803507-7db8-4e13-9205-d7b10b8ed945" volumeName="kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-tuned" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487487    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb803507-7db8-4e13-9205-d7b10b8ed945" volumeName="kubernetes.io/projected/eb803507-7db8-4e13-9205-d7b10b8ed945-kube-api-access-4jn5m" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487498    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="365c35a5-ff31-4e62-82bc-da9d408a4ff0" volumeName="kubernetes.io/projected/365c35a5-ff31-4e62-82bc-da9d408a4ff0-kube-api-access-hhjfx" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487509    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7245c5d9-0734-406c-a2bf-ff06c31c791a" volumeName="kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487572    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0fe9083-f455-4f5f-a452-37d368be1769" volumeName="kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487584    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e647d5bf-5715-4c76-b79f-4d6fb5469dd4" volumeName="kubernetes.io/projected/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-kube-api-access-xkpz9" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487595    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9660c039-cb78-44b3-a886-63c1dd6a93d8" volumeName="kubernetes.io/projected/9660c039-cb78-44b3-a886-63c1dd6a93d8-kube-api-access-cvlrz" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487610    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bbb4015f-b6ef-4a06-8184-4212485732d5" volumeName="kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-binary-copy" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487621    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee1ea063-3567-4b9e-a55f-ecea343bc7f0" volumeName="kubernetes.io/projected/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kube-api-access-2bbfg" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487634    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67223fe5-9de3-4a9d-ad37-d7f1735bf0de" volumeName="kubernetes.io/configmap/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-config-volume" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487645    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0fe9083-f455-4f5f-a452-37d368be1769" volumeName="kubernetes.io/projected/e0fe9083-f455-4f5f-a452-37d368be1769-kube-api-access-8ffzk" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487656    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5e38e39-299e-4d1f-ab21-aed0321cf7b1" volumeName="kubernetes.io/projected/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-kube-api-access-m8zf6" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.487671    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e647d5bf-5715-4c76-b79f-4d6fb5469dd4" volumeName="kubernetes.io/secret/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-key" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488149    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62ce59d3-403d-403e-b150-805154000f23" volumeName="kubernetes.io/projected/62ce59d3-403d-403e-b150-805154000f23-kube-api-access-bgqb9" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488164    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bbb4015f-b6ef-4a06-8184-4212485732d5" volumeName="kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488171    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8815fb-55ec-4632-aa1e-aa519da33bd2" volumeName="kubernetes.io/projected/bd8815fb-55ec-4632-aa1e-aa519da33bd2-kube-api-access-hqh2q" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488192    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da4b95f0-1840-4912-b202-2e49232dfac9" volumeName="kubernetes.io/projected/da4b95f0-1840-4912-b202-2e49232dfac9-kube-api-access-x6hms" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488199    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5e38e39-299e-4d1f-ab21-aed0321cf7b1" volumeName="kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-daemon-config" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488206    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e647d5bf-5715-4c76-b79f-4d6fb5469dd4" volumeName="kubernetes.io/configmap/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-cabundle" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488213    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7" volumeName="kubernetes.io/projected/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-kube-api-access-j9kxq" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488220    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" volumeName="kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488226    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bbb4015f-b6ef-4a06-8184-4212485732d5" volumeName="kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488233    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8815fb-55ec-4632-aa1e-aa519da33bd2" volumeName="kubernetes.io/configmap/bd8815fb-55ec-4632-aa1e-aa519da33bd2-serviceca" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488240    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a21de7b-d2bd-4174-aee2-047a16242992" volumeName="kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488267    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" volumeName="kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488278    4538 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62ce59d3-403d-403e-b150-805154000f23" volumeName="kubernetes.io/secret/62ce59d3-403d-403e-b150-805154000f23-cert" seLinuxMountContext=""
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488289    4538 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488295    4538 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488422    4538 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 14:01:07 +0000 UTC" deadline="2028-03-27 15:45:48.493826813 +0000 UTC"
Oct 30 14:06:46.488561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.488457    4538 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12337h39m2.005372992s"
Oct 30 14:06:46.490531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.490482    4538 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 14:06:46.490531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.490497    4538 factory.go:55] Registering systemd factory
Oct 30 14:06:46.490531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.490506    4538 factory.go:223] Registration of the systemd container factory successfully
Oct 30 14:06:46.494478 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.493356    4538 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 14:06:46.497140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.495171    4538 factory.go:153] Registering CRI-O factory
Oct 30 14:06:46.497140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.495188    4538 factory.go:223] Registration of the crio container factory successfully
Oct 30 14:06:46.497140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.495206    4538 factory.go:103] Registering Raw factory
Oct 30 14:06:46.497140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.495220    4538 manager.go:1199] Started watching for new ooms in manager
Oct 30 14:06:46.497140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.495637    4538 manager.go:319] Starting recovery of all containers
Oct 30 14:06:46.553020 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.552938    4538 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 14:06:46.557271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.557219    4538 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:46.565063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.565023    4538 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:46.565163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.565074    4538 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:46.568301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.568222    4538 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 14:06:46.574477 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.574463    4538 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 14:06:46.574556 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.574549    4538 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 14:06:46.574613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.574607    4538 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 14:06:46.574695 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:46.574682    4538 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 14:06:46.594100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.594078    4538 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 14:06:46.608371 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.608346    4538 generic.go:356] "Generic (PLEG): container finished" podID="977bf51bbc68541b82d14af211bb5f03" containerID="903c754d3fc7c8eb13beff08b41219464874b1e7461056e07640369f192f2d59" exitCode=0
Oct 30 14:06:46.617219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.617192    4538 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="4b3c27428cc91dfb711b51d5a16714c211ae07d9cad7b5fe43c6dc5875a9f8c0" exitCode=0
Oct 30 14:06:46.617320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.617219    4538 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="c04d7b53b8c0f27cb6873bbea70cb2fd4da062632b9a2bcdb6c4451c64be5e6c" exitCode=0
Oct 30 14:06:46.617320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.617229    4538 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="ef9fcb67deffb222a733e2d08c384375b0cc8c3fb4d1f4069427127e1c335437" exitCode=0
Oct 30 14:06:46.617320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.617241    4538 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="1ab3d8757b6b480aa773bebba09fd578695bd777fa7eda8760292f6b354ce911" exitCode=0
Oct 30 14:06:46.617320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.617274    4538 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="265e7ef75277f5da430bf401ff6b5675b6762160b36e818f61fa31bff3fb0755" exitCode=0
Oct 30 14:06:46.617320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.617283    4538 generic.go:356] "Generic (PLEG): container finished" podID="bbb4015f-b6ef-4a06-8184-4212485732d5" containerID="29053a8fee3bdfce7e491ee06e84a6b82aa578ce90f49cc19b4b54d3b768c457" exitCode=0
Oct 30 14:06:46.623482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.623466    4538 manager.go:324] Recovery completed
Oct 30 14:06:46.640849 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.640826    4538 cpu_manager.go:226] "Starting" policy="none"
Oct 30 14:06:46.640849 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.640844    4538 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 14:06:46.640958 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.640863    4538 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 14:06:46.641022 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641003    4538 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 14:06:46.641056 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641024    4538 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 14:06:46.641056 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641046    4538 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 14:06:46.641056 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641054    4538 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 14:06:46.641130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641060    4538 policy_none.go:50] "Start"
Oct 30 14:06:46.641130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641071    4538 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 14:06:46.641130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641082    4538 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 14:06:46.641220 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641210    4538 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 14:06:46.641266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641220    4538 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 14:06:46.641266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.641226    4538 policy_none.go:44] "Start"
Oct 30 14:06:46.645190 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.645160    4538 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 14:06:46.647949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.647934    4538 manager.go:341] "Starting Device Plugin manager"
Oct 30 14:06:46.648596 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:46.648569    4538 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 14:06:46.648596 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.648587    4538 server.go:87] "Starting device plugin registration server"
Oct 30 14:06:46.648886 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.648872    4538 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 14:06:46.648975 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.648887    4538 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 14:06:46.649067 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.649053    4538 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 14:06:46.649161 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.649132    4538 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 14:06:46.649758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.649742    4538 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 14:06:46.649758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.649757    4538 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 14:06:46.649928 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.649836    4538 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T14:06:46.64915927Z","UUID":"cd333a5a-b91e-44f7-a7ba-ad5a4b229a54","Handler":null,"Name":"","Endpoint":""}
Oct 30 14:06:46.650383 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:46.650365    4538 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 14:06:46.652024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.651478    4538 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 14:06:46.652024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.651502    4538 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 14:06:46.674812 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.674777    4538 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"]
Oct 30 14:06:46.675421 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675403    4538 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.675582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675566    4538 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.675859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675831    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"977bf51bbc68541b82d14af211bb5f03","Type":"ContainerStarted","Data":"35cbea540601ffadad6b82e0ae458e577299b44e2b9aa8339f34767290fc1018"}
Oct 30 14:06:46.675961 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675893    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"977bf51bbc68541b82d14af211bb5f03","Type":"ContainerDied","Data":"903c754d3fc7c8eb13beff08b41219464874b1e7461056e07640369f192f2d59"}
Oct 30 14:06:46.675961 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675927    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal" event={"ID":"977bf51bbc68541b82d14af211bb5f03","Type":"ContainerStarted","Data":"d9e18a2cad6a4a06c830fa706aadbd4effcc6fe14a2159f82b897184acaa681d"}
Oct 30 14:06:46.675961 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675955    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" event={"ID":"01f7fab24259baa567abf70da12a1430","Type":"ContainerStarted","Data":"719fe77a6ae29daf1312a1a95a818510423dddde47eb843eff115e8b93185529"}
Oct 30 14:06:46.676094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.675983    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal" event={"ID":"01f7fab24259baa567abf70da12a1430","Type":"ContainerStarted","Data":"25ef8b5ffd33a0f892f4653f8dcb58a3cdc926f05fee1f7fd35c8d6ab3b1c57f"}
Oct 30 14:06:46.703756 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.703733    4538 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 14:06:46.703847 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:46.703785    4538 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.704610 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.704593    4538 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 14:06:46.704666 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:46.704648    4538 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.749552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.749534    4538 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 14:06:46.750757 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.750739    4538 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientMemory"
Oct 30 14:06:46.750852 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.750774    4538 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasNoDiskPressure"
Oct 30 14:06:46.750852 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.750791    4538 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-7.ec2.internal" event="NodeHasSufficientPID"
Oct 30 14:06:46.750852 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.750832    4538 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.753999 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.753979    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.754095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.754005    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01f7fab24259baa567abf70da12a1430-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"01f7fab24259baa567abf70da12a1430\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.754095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.754024    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.804593 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.804541    4538 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.804661 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.804596    4538 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.854951 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.854925    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.854951 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.854952    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.855086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.854969    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01f7fab24259baa567abf70da12a1430-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"01f7fab24259baa567abf70da12a1430\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.855086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.855003    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01f7fab24259baa567abf70da12a1430-config\") pod \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" (UID: \"01f7fab24259baa567abf70da12a1430\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.855086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.855027    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:46.855086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:46.855039    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/977bf51bbc68541b82d14af211bb5f03-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" (UID: \"977bf51bbc68541b82d14af211bb5f03\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:47.472899 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.472870    4538 apiserver.go:52] "Watching apiserver"
Oct 30 14:06:47.568655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.568630    4538 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 14:06:47.569120 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.569095    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-5jjg9","openshift-dns/dns-default-ws6jd","openshift-insights/periodic-gathering-sdd5w-49dtr","openshift-network-diagnostics/network-check-target-rksrm","kube-system/konnectivity-agent-g2tcs","openshift-insights/insights-runtime-extractor-85889","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk","openshift-ingress-canary/ingress-canary-gfk9t","openshift-image-registry/node-ca-7r6xm","openshift-multus/multus-additional-cni-plugins-5lp65","openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal","kube-system/global-pull-secret-syncer-vbbts","openshift-cluster-node-tuning-operator/tuned-gq9cb","openshift-dns/node-resolver-z4dbd","openshift-multus/network-metrics-daemon-j6f9w","openshift-ovn-kubernetes/ovnkube-node-kdjxv","openshift-service-ca/service-ca-5fffc97bdf-j4trr","kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal","openshift-multus/multus-95tj6"]
Oct 30 14:06:47.571060 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.571028    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:47.576059 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.576040    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.576452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.576438    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.586313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586253    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 14:06:47.586313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586293    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kvlg\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586311    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586315    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586370    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94q7c\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586385    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586389    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z4lqh\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586411    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586428    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586433    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 14:06:47.586454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.586444    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.587094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587073    4538 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 14:06:47.587181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587101    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 14:06:47.587181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587078    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 14:06:47.587327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587215    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 14:06:47.587327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587221    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.587327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587218    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 14:06:47.587327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587231    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 14:06:47.587327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587257    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-c5nrs\""
Oct 30 14:06:47.587327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587273    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 14:06:47.587553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587334    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.587553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587418    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mfmhk\""
Oct 30 14:06:47.587553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587496    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 14:06:47.587553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587514    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.587553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587545    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w5lxm\""
Oct 30 14:06:47.587690 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.587617    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2dqn6\""
Oct 30 14:06:47.596956 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.596943    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.596956 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.596952    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkz6n\""
Oct 30 14:06:47.597039 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.596954    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.598417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598398    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 14:06:47.598417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598406    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.598585 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598462    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rgz8z\""
Oct 30 14:06:47.598585 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598466    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 14:06:47.598809 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598793    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.598859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598827    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mlbs5\""
Oct 30 14:06:47.598981 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598964    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.598981 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598977    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598967    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598969    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.598970    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599003    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599016    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599021    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599017    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dqvfb\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599047    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.599090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599059    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-4w84p\""
Oct 30 14:06:47.599446 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599106    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 14:06:47.599446 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599163    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.599611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.599590    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5t6gk\""
Oct 30 14:06:47.625020 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.625000    4538 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:47.625167 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.625152    4538 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:47.648466 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.648444    4538 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 14:06:47.648556 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.648491    4538 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-7.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:47.649570 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.649556    4538 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 14:06:47.649617 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.649590    4538 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-7.ec2.internal"
Oct 30 14:06:47.654063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654046    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 30 14:06:47.654144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654130    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g7grg\""
Oct 30 14:06:47.654222 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654210    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 14:06:47.654289 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654240    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4szpv\""
Oct 30 14:06:47.654365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654352    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x2qs\""
Oct 30 14:06:47.654395 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654363    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4n4gw\""
Oct 30 14:06:47.654697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.654685    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h2cvg\""
Oct 30 14:06:47.658538 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658519    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.658611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658553    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-socket-dir-parent\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.658611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658580    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-netns\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.658611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658606    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4b95f0-1840-4912-b202-2e49232dfac9-data-volume\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.658751 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658643    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvwl\" (UniqueName: \"kubernetes.io/projected/bbb4015f-b6ef-4a06-8184-4212485732d5-kube-api-access-9bvwl\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.658751 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658686    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8815fb-55ec-4632-aa1e-aa519da33bd2-host\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.658751 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658688    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4b95f0-1840-4912-b202-2e49232dfac9-data-volume\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.658848 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658773    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-kubelet\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.658848 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658808    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-daemon-config\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.658848 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658829    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.658964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658847    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.658964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658863    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.658964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658877    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-bin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.658964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658893    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8zf6\" (UniqueName: \"kubernetes.io/projected/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-kube-api-access-m8zf6\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.658964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658908    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-ovn\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.658964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658923    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-env-overrides\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.658988    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659026    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-tmp-dir\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659068    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659071    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659109    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-env-overrides\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659116    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-etc-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659113    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-daemon-config\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.659205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659160    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-tmp-dir\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659222    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659267    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-config\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659292    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da4b95f0-1840-4912-b202-2e49232dfac9-crio-socket\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659310    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kxq\" (UniqueName: \"kubernetes.io/projected/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-kube-api-access-j9kxq\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659330    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-system-cni-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659370    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659390    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-agent-certs\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659439    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-config\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659463    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62ce59d3-403d-403e-b150-805154000f23-cert\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:47.659504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659465    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a21de7b-d2bd-4174-aee2-047a16242992-original-pull-secret\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659515    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-slash\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659553    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659575    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffzk\" (UniqueName: \"kubernetes.io/projected/e0fe9083-f455-4f5f-a452-37d368be1769-kube-api-access-8ffzk\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659590    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkpz9\" (UniqueName: \"kubernetes.io/projected/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-kube-api-access-xkpz9\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659618    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-modprobe-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659641    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jn5m\" (UniqueName: \"kubernetes.io/projected/eb803507-7db8-4e13-9205-d7b10b8ed945-kube-api-access-4jn5m\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659644    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62ce59d3-403d-403e-b150-805154000f23-cert\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659662    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqh2q\" (UniqueName: \"kubernetes.io/projected/bd8815fb-55ec-4632-aa1e-aa519da33bd2-kube-api-access-hqh2q\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659727    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bplx6\" (UniqueName: \"kubernetes.io/projected/d37b2640-a448-415d-b601-45b9b25221d2-kube-api-access-bplx6\") pod \"migrator-66df5d496b-tl782\" (UID: \"d37b2640-a448-415d-b601-45b9b25221d2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659768    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysconfig\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659775    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-agent-certs\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659797    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-lib-modules\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659835    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-k8s-cni-cncf-io\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659866    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9660c039-cb78-44b3-a886-63c1dd6a93d8-host-slash\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.659915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659897    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-kubelet\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.660365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659924    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-netd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.660365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659949    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-cnibin\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.660365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659977    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-device-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.660447 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.659997    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-hosts-file\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.660447 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660407    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-run\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.660447 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660425    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8t5\" (UniqueName: \"kubernetes.io/projected/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-kube-api-access-rn8t5\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.660447 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660441    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.660607 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660466    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-systemd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.660607 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660484    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-log-socket\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.660607 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660524    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.660607 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660543    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.660607 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660582    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cni-binary-copy\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.660889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660617    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-var-lib-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.660889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660661    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.660889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660724    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hms\" (UniqueName: \"kubernetes.io/projected/da4b95f0-1840-4912-b202-2e49232dfac9-kube-api-access-x6hms\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.660889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660735    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.660889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660782    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cni-binary-copy\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660893    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-systemd\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660915    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-tmp\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660931    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-konnectivity-ca\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660952    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvlrz\" (UniqueName: \"kubernetes.io/projected/9660c039-cb78-44b3-a886-63c1dd6a93d8-kube-api-access-cvlrz\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660974    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-systemd-units\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.660996    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-node-log\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661005    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-tmp\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661092    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-bin\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661108    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fe9083-f455-4f5f-a452-37d368be1769-ovn-node-metrics-cert\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661122    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-tuned\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661147    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661168    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-tuned\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661167    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb0acc-a13c-4ca6-b00f-69e4c03eca15-konnectivity-ca\") pod \"konnectivity-agent-g2tcs\" (UID: \"4fbb0acc-a13c-4ca6-b00f-69e4c03eca15\") " pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661166    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-multus-certs\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661207    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661222    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bbfg\" (UniqueName: \"kubernetes.io/projected/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kube-api-access-2bbfg\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661274    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-script-lib\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661288    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0fe9083-f455-4f5f-a452-37d368be1769-ovn-node-metrics-cert\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661304    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-cabundle\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661336    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-kubelet-config\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661362    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-conf\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661388    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661429    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd8815fb-55ec-4632-aa1e-aa519da33bd2-serviceca\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661461    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-system-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661470    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661472    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0fe9083-f455-4f5f-a452-37d368be1769-ovnkube-script-lib\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661503    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661529    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cnibin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661544    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-multus\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661584    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-dbus\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661599    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd8815fb-55ec-4632-aa1e-aa519da33bd2-serviceca\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661607    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-host\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661629    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-tmp-dir\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661647    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqb9\" (UniqueName: \"kubernetes.io/projected/62ce59d3-403d-403e-b150-805154000f23-kube-api-access-bgqb9\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661696    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-tmp-dir\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661723    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-netns\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661746    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-conf-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661762    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-etc-kubernetes\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.661806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661792    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661826    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661845    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjfx\" (UniqueName: \"kubernetes.io/projected/365c35a5-ff31-4e62-82bc-da9d408a4ff0-kube-api-access-hhjfx\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661877    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-kubernetes\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661923    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661959    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-config-volume\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.661977    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662025    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-key\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662057    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662090    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662133    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-sys\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662176    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-var-lib-kubelet\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662214    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-hostroot\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662234    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbb4015f-b6ef-4a06-8184-4212485732d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662275    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9660c039-cb78-44b3-a886-63c1dd6a93d8-iptables-alerter-script\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662276    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-key\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:47.662482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662407    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.662926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.662531    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9660c039-cb78-44b3-a886-63c1dd6a93d8-iptables-alerter-script\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.682601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.682575    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffzk\" (UniqueName: \"kubernetes.io/projected/e0fe9083-f455-4f5f-a452-37d368be1769-kube-api-access-8ffzk\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.682697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.682620    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8zf6\" (UniqueName: \"kubernetes.io/projected/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-kube-api-access-m8zf6\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.682991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.682970    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jn5m\" (UniqueName: \"kubernetes.io/projected/eb803507-7db8-4e13-9205-d7b10b8ed945-kube-api-access-4jn5m\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.683801 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.683778    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqh2q\" (UniqueName: \"kubernetes.io/projected/bd8815fb-55ec-4632-aa1e-aa519da33bd2-kube-api-access-hqh2q\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.683909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.683784    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8t5\" (UniqueName: \"kubernetes.io/projected/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-kube-api-access-rn8t5\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.684039 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.684017    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvlrz\" (UniqueName: \"kubernetes.io/projected/9660c039-cb78-44b3-a886-63c1dd6a93d8-kube-api-access-cvlrz\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.684116 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.684066    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kxq\" (UniqueName: \"kubernetes.io/projected/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-kube-api-access-j9kxq\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.684391 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.684371    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvwl\" (UniqueName: \"kubernetes.io/projected/bbb4015f-b6ef-4a06-8184-4212485732d5-kube-api-access-9bvwl\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.684529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.684507    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqb9\" (UniqueName: \"kubernetes.io/projected/62ce59d3-403d-403e-b150-805154000f23-kube-api-access-bgqb9\") pod \"ingress-canary-gfk9t\" (UID: \"62ce59d3-403d-403e-b150-805154000f23\") " pod="openshift-ingress-canary/ingress-canary-gfk9t"
Oct 30 14:06:47.686512 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686488    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.686601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686517    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 14:06:47.686601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686540    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.686699 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686624    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 14:06:47.686699 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686678    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.686827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686772    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 14:06:47.686827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686781    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.686827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686789    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 30 14:06:47.686827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686781    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 14:06:47.687012 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.686900    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 30 14:06:47.687914 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.687894    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 14:06:47.688100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.688084    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjfx\" (UniqueName: \"kubernetes.io/projected/365c35a5-ff31-4e62-82bc-da9d408a4ff0-kube-api-access-hhjfx\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:47.689193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.689176    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.689439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.689423    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.690231 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.690210    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hms\" (UniqueName: \"kubernetes.io/projected/da4b95f0-1840-4912-b202-2e49232dfac9-kube-api-access-x6hms\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.690332 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.690318    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v2n\" (UniqueName: \"kubernetes.io/projected/7245c5d9-0734-406c-a2bf-ff06c31c791a-kube-api-access-j8v2n\") pod \"network-check-target-rksrm\" (UID: \"7245c5d9-0734-406c-a2bf-ff06c31c791a\") " pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:47.690406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.690391    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") pod \"periodic-gathering-sdd5w-49dtr\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") " pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:06:47.692075 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.692053    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-signing-cabundle\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:47.692207 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.692194    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-config-volume\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.692723 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.692708    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkpz9\" (UniqueName: \"kubernetes.io/projected/e647d5bf-5715-4c76-b79f-4d6fb5469dd4-kube-api-access-xkpz9\") pod \"service-ca-5fffc97bdf-j4trr\" (UID: \"e647d5bf-5715-4c76-b79f-4d6fb5469dd4\") " pod="openshift-service-ca/service-ca-5fffc97bdf-j4trr"
Oct 30 14:06:47.694465 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.694450    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bplx6\" (UniqueName: \"kubernetes.io/projected/d37b2640-a448-415d-b601-45b9b25221d2-kube-api-access-bplx6\") pod \"migrator-66df5d496b-tl782\" (UID: \"d37b2640-a448-415d-b601-45b9b25221d2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tl782"
Oct 30 14:06:47.695230 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.695216    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bbfg\" (UniqueName: \"kubernetes.io/projected/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kube-api-access-2bbfg\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.763070 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763047    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-etc-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763070 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763071    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763092    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da4b95f0-1840-4912-b202-2e49232dfac9-crio-socket\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763115    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-system-cni-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763119    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-etc-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763130    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763138    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763176    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da4b95f0-1840-4912-b202-2e49232dfac9-crio-socket\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763183    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.763211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763193    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-slash\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763217    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763243    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-modprobe-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763284    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysconfig\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763220    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-system-cni-dir\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763281    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-slash\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763293    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763314    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-lib-modules\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763341    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysconfig\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763385    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-k8s-cni-cncf-io\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763347    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-k8s-cni-cncf-io\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763407    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-modprobe-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763429    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9660c039-cb78-44b3-a886-63c1dd6a93d8-host-slash\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763434    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-lib-modules\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763458    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-kubelet\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763481    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-netd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763505    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-cnibin\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763510    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-kubelet\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763512    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9660c039-cb78-44b3-a886-63c1dd6a93d8-host-slash\") pod \"iptables-alerter-5jjg9\" (UID: \"9660c039-cb78-44b3-a886-63c1dd6a93d8\") " pod="openshift-network-operator/iptables-alerter-5jjg9"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763528    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-device-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763547    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbb4015f-b6ef-4a06-8184-4212485732d5-cnibin\") pod \"multus-additional-cni-plugins-5lp65\" (UID: \"bbb4015f-b6ef-4a06-8184-4212485732d5\") " pod="openshift-multus/multus-additional-cni-plugins-5lp65"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763530    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-netd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763558    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-device-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763552    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-hosts-file\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763589    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-run\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763598    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7-hosts-file\") pod \"node-resolver-z4dbd\" (UID: \"1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7\") " pod="openshift-dns/node-resolver-z4dbd"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763606    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763621    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-systemd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763633    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-log-socket\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763645    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-run\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763654    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763681    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-log-socket\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763681    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-var-lib-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763690    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.763679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763683    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-systemd\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763710    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-var-lib-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763719    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.763748    4538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763755    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-openvswitch\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763780    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-systemd\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.763805    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:48.263791199 +0000 UTC m=+1.898737797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763747    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-systemd\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763829    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-systemd-units\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763862    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-node-log\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763876    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-bin\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763891    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763904    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-multus-certs\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763917    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763932    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-kubelet-config\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763945    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-node-log\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763953    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-conf\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763965    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-systemd-units\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763983    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-system-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.763995    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-kubelet-config\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764001    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-multus-certs\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764028    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-cni-bin\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764029    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764053    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764060    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-conf\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.764077    4538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764088    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-system-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764090    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cnibin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764110    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-cni-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.764139    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:48.264120798 +0000 UTC m=+1.899067397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764162    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-multus\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764167    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-cnibin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764172    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-multus\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764192    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-dbus\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764209    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-host\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764223    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-netns\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764238    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-conf-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764266    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a21de7b-d2bd-4174-aee2-047a16242992-dbus\") pod \"global-pull-secret-syncer-vbbts\" (UID: \"2a21de7b-d2bd-4174-aee2-047a16242992\") " pod="kube-system/global-pull-secret-syncer-vbbts"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764283    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-etc-kubernetes\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764294    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-host\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764297    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-run-netns\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764308    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764310    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-conf-dir\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764309    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-etc-kubernetes\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764337    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764352    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764372    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-kubernetes\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764391    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.764394    4538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764407    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-sys\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764420    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-var-lib-kubelet\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:47.764435    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:48.264423188 +0000 UTC m=+1.899369786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : secret "metrics-daemon-secret" not found
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764460    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-hostroot\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764465    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-sys\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764475    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-var-lib-kubelet\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764485    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764503    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-hostroot\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764467    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-kubernetes\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764522    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb803507-7db8-4e13-9205-d7b10b8ed945-etc-sysctl-d\") pod \"tuned-gq9cb\" (UID: \"eb803507-7db8-4e13-9205-d7b10b8ed945\") " pod="openshift-cluster-node-tuning-operator/tuned-gq9cb"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764546    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-socket-dir-parent\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764510    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-multus-socket-dir-parent\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764526    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764570    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-netns\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764586    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8815fb-55ec-4632-aa1e-aa519da33bd2-host\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764600    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-kubelet\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764640    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764658    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-bin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764662    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-kubelet\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764672    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-ovn\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764687    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764640    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd8815fb-55ec-4632-aa1e-aa519da33bd2-host\") pod \"node-ca-7r6xm\" (UID: \"bd8815fb-55ec-4632-aa1e-aa519da33bd2\") " pod="openshift-image-registry/node-ca-7r6xm"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764718    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5e38e39-299e-4d1f-ab21-aed0321cf7b1-host-var-lib-cni-bin\") pod \"multus-95tj6\" (UID: \"e5e38e39-299e-4d1f-ab21-aed0321cf7b1\") " pod="openshift-multus/multus-95tj6"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764639    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-host-run-netns\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764747    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0fe9083-f455-4f5f-a452-37d368be1769-run-ovn\") pod \"ovnkube-node-kdjxv\" (UID: \"e0fe9083-f455-4f5f-a452-37d368be1769\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:47.764781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.764758    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ee1ea063-3567-4b9e-a55f-ecea343bc7f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rwltk\" (UID: \"ee1ea063-3567-4b9e-a55f-ecea343bc7f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rwltk"
Oct 30 14:06:47.766910 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:47.765280    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da4b95f0-1840-4912-b202-2e49232dfac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:48.268087 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:48.268053    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:48.268284 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:48.268092    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:48.268284 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:48.268136    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:48.268284 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:48.268204    4538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:48.268284 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:48.268213    4538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 14:06:48.268474 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:48.268281    4538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:48.268474 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:48.268297    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:49.268283613 +0000 UTC m=+2.903230215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:48.268474 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:48.268314    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:49.26830769 +0000 UTC m=+2.903254293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : secret "metrics-daemon-secret" not found
Oct 30 14:06:48.268474 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:48.268339    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:49.268327588 +0000 UTC m=+2.903274187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:48.988404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:48.988377    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:06:49.274550 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:49.274475    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:49.274550 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:49.274514    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:49.274729 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:49.274551    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:49.274729 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:49.274636    4538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 14:06:49.274729 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:49.274668    4538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:49.274729 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:49.274637    4538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:49.274729 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:49.274684    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs podName:365c35a5-ff31-4e62-82bc-da9d408a4ff0 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:51.274669331 +0000 UTC m=+4.909615929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs") pod "network-metrics-daemon-j6f9w" (UID: "365c35a5-ff31-4e62-82bc-da9d408a4ff0") : secret "metrics-daemon-secret" not found
Oct 30 14:06:49.274729 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:49.274731    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:51.274718505 +0000 UTC m=+4.909665119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:49.274914 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:49.274745    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:51.274737949 +0000 UTC m=+4.909684562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:49.404089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:49.404055    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:51.006372 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.006344    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4dbd_1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7/dns-node-resolver/0.log"
Oct 30 14:06:51.287619 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.287541    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:51.287619 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.287581    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:51.287799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.287624    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:51.287799 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:51.287697    4538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 14:06:51.287799 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:51.287719    4538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:51.287799 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:51.287760    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls podName:67223fe5-9de3-4a9d-ad37-d7f1735bf0de nodeName:}" failed. No retries permitted until 2026-10-30 14:06:55.287745958 +0000 UTC m=+8.922692557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls") pod "dns-default-ws6jd" (UID: "67223fe5-9de3-4a9d-ad37-d7f1735bf0de") : secret "dns-default-metrics-tls" not found
Oct 30 14:06:51.287799 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:51.287775    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:55.28776891 +0000 UTC m=+8.922715508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:51.287961 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.287943    4538 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 14:06:51.289867 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.289840    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/365c35a5-ff31-4e62-82bc-da9d408a4ff0-metrics-certs\") pod \"network-metrics-daemon-j6f9w\" (UID: \"365c35a5-ff31-4e62-82bc-da9d408a4ff0\") " pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:51.471317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.471285    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j6f9w"
Oct 30 14:06:51.606451 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.606425    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7r6xm_bd8815fb-55ec-4632-aa1e-aa519da33bd2/node-ca/0.log"
Oct 30 14:06:51.762987 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.762951    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j6f9w"]
Oct 30 14:06:51.767850 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:51.767817    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365c35a5_ff31_4e62_82bc_da9d408a4ff0.slice/crio-a7b3fe751335f6b66bd75fadfa9334b93d400604eedbcef268152febed93c3a4 WatchSource:0}: Error finding container a7b3fe751335f6b66bd75fadfa9334b93d400604eedbcef268152febed93c3a4: Status 404 returned error can't find the container with id a7b3fe751335f6b66bd75fadfa9334b93d400604eedbcef268152febed93c3a4
Oct 30 14:06:51.769806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:51.769789    4538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 14:06:52.407951 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:52.407894    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gfk9t_62ce59d3-403d-403e-b150-805154000f23/serve-healthcheck-canary/0.log"
Oct 30 14:06:52.637414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:52.637384    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j6f9w" event={"ID":"365c35a5-ff31-4e62-82bc-da9d408a4ff0","Type":"ContainerStarted","Data":"a7b3fe751335f6b66bd75fadfa9334b93d400604eedbcef268152febed93c3a4"}
Oct 30 14:06:53.006934 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:53.006861    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-tl782_d37b2640-a448-415d-b601-45b9b25221d2/migrator/0.log"
Oct 30 14:06:53.645426 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:53.645394    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j6f9w" event={"ID":"365c35a5-ff31-4e62-82bc-da9d408a4ff0","Type":"ContainerStarted","Data":"89bce7490cc31f8500024f4d81cb467dbea2d708a3808296ee876ce2c1f2dd30"}
Oct 30 14:06:53.645789 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:53.645464    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j6f9w" event={"ID":"365c35a5-ff31-4e62-82bc-da9d408a4ff0","Type":"ContainerStarted","Data":"0013a620e03a2b40735e6e617590eb0b5a60a3855c0e42c86b67a3445c928a81"}
Oct 30 14:06:55.312891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:55.312852    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:06:55.312891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:55.312896    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:55.313389 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:55.313011    4538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:55.313389 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:06:55.313089    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls podName:da4b95f0-1840-4912-b202-2e49232dfac9 nodeName:}" failed. No retries permitted until 2026-10-30 14:07:03.313071103 +0000 UTC m=+16.948017721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85889" (UID: "da4b95f0-1840-4912-b202-2e49232dfac9") : secret "insights-runtime-extractor-tls" not found
Oct 30 14:06:55.315104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:55.315086    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67223fe5-9de3-4a9d-ad37-d7f1735bf0de-metrics-tls\") pod \"dns-default-ws6jd\" (UID: \"67223fe5-9de3-4a9d-ad37-d7f1735bf0de\") " pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:55.376734 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:55.376705    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:06:55.668964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:55.668928    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ws6jd"]
Oct 30 14:06:55.673673 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:06:55.673647    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67223fe5_9de3_4a9d_ad37_d7f1735bf0de.slice/crio-5bec5f6c8f548c9354a6165f567f84dd06cadd3018284a43f7c6a743bd3d3236 WatchSource:0}: Error finding container 5bec5f6c8f548c9354a6165f567f84dd06cadd3018284a43f7c6a743bd3d3236: Status 404 returned error can't find the container with id 5bec5f6c8f548c9354a6165f567f84dd06cadd3018284a43f7c6a743bd3d3236
Oct 30 14:06:56.656481 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:56.656413    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ws6jd" event={"ID":"67223fe5-9de3-4a9d-ad37-d7f1735bf0de","Type":"ContainerStarted","Data":"5bec5f6c8f548c9354a6165f567f84dd06cadd3018284a43f7c6a743bd3d3236"}
Oct 30 14:06:56.918098 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:56.918021    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:06:56.918288 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:56.918273    4538 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 14:06:57.661875 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:57.661843    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ws6jd" event={"ID":"67223fe5-9de3-4a9d-ad37-d7f1735bf0de","Type":"ContainerStarted","Data":"489e62f90c948ef940a3dc94cdb9c46873ebaeb90c7a15168184eae2c80867d5"}
Oct 30 14:06:57.662355 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:57.661894    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ws6jd" event={"ID":"67223fe5-9de3-4a9d-ad37-d7f1735bf0de","Type":"ContainerStarted","Data":"8799f1e4e14ea924a87fd80417b9083bd56a2449b41e604166d058af70bf3ac9"}
Oct 30 14:06:57.662355 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:06:57.661983    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:07:01.793206 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:01.793172    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g2tcs"
Oct 30 14:07:02.496955 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.496927    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-hq6r9"]
Oct 30 14:07:02.500017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.499995    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.516987 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.516965    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 14:07:02.529433 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.529409    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 14:07:02.529521 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.529445    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-wgphz\""
Oct 30 14:07:02.531327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.531304    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-hq6r9"]
Oct 30 14:07:02.596881 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.596853    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"]
Oct 30 14:07:02.599864 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.599845    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d9f979958-4jkmx"]
Oct 30 14:07:02.599982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.599964    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:02.602551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.602533    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.620177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.620157    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 14:07:02.620446 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.620428    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 14:07:02.620548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.620445    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"]
Oct 30 14:07:02.620548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.620495    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 14:07:02.629971 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.629952    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfwlz\""
Oct 30 14:07:02.629971 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.629963    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h58b9\""
Oct 30 14:07:02.630083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.629980    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 14:07:02.646529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.646508    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 14:07:02.648644 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.648618    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9f979958-4jkmx"]
Oct 30 14:07:02.666936 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.666917    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a50d6557-45f3-486a-abbf-466c2a92b7c1-tmp\") pod \"downloads-6dd789c8b7-hq6r9\" (UID: \"a50d6557-45f3-486a-abbf-466c2a92b7c1\") " pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.667026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.666948    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6xh\" (UniqueName: \"kubernetes.io/projected/a50d6557-45f3-486a-abbf-466c2a92b7c1-kube-api-access-dq6xh\") pod \"downloads-6dd789c8b7-hq6r9\" (UID: \"a50d6557-45f3-486a-abbf-466c2a92b7c1\") " pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.735958 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.735935    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdjxv"
Oct 30 14:07:02.767993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.767937    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32b3d943-4522-4898-90cc-b4c89db038cd-ca-trust-extracted\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.767993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.767970    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32b3d943-4522-4898-90cc-b4c89db038cd-installation-pull-secrets\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.767995    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a50d6557-45f3-486a-abbf-466c2a92b7c1-tmp\") pod \"downloads-6dd789c8b7-hq6r9\" (UID: \"a50d6557-45f3-486a-abbf-466c2a92b7c1\") " pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.768189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768130    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6xh\" (UniqueName: \"kubernetes.io/projected/a50d6557-45f3-486a-abbf-466c2a92b7c1-kube-api-access-dq6xh\") pod \"downloads-6dd789c8b7-hq6r9\" (UID: \"a50d6557-45f3-486a-abbf-466c2a92b7c1\") " pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.768189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768186    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8d6138-c6ed-481f-93e5-dc7924b750e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-95wv7\" (UID: \"0a8d6138-c6ed-481f-93e5-dc7924b750e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:02.768364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768206    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-registry-tls\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768226    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-bound-sa-token\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768303    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32b3d943-4522-4898-90cc-b4c89db038cd-image-registry-private-configuration\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768328    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vq6j\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-kube-api-access-6vq6j\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768348    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32b3d943-4522-4898-90cc-b4c89db038cd-registry-certificates\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768362    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32b3d943-4522-4898-90cc-b4c89db038cd-trusted-ca\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.768583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.768406    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a50d6557-45f3-486a-abbf-466c2a92b7c1-tmp\") pod \"downloads-6dd789c8b7-hq6r9\" (UID: \"a50d6557-45f3-486a-abbf-466c2a92b7c1\") " pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.795143 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.795119    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6xh\" (UniqueName: \"kubernetes.io/projected/a50d6557-45f3-486a-abbf-466c2a92b7c1-kube-api-access-dq6xh\") pod \"downloads-6dd789c8b7-hq6r9\" (UID: \"a50d6557-45f3-486a-abbf-466c2a92b7c1\") " pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.810970 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.810951    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:02.869613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.869582    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8d6138-c6ed-481f-93e5-dc7924b750e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-95wv7\" (UID: \"0a8d6138-c6ed-481f-93e5-dc7924b750e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:02.869748 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.869627    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-registry-tls\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870154    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-bound-sa-token\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870276 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870233    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32b3d943-4522-4898-90cc-b4c89db038cd-image-registry-private-configuration\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870339 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870292    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vq6j\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-kube-api-access-6vq6j\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870339 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870320    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32b3d943-4522-4898-90cc-b4c89db038cd-registry-certificates\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870347    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32b3d943-4522-4898-90cc-b4c89db038cd-trusted-ca\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870398    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32b3d943-4522-4898-90cc-b4c89db038cd-ca-trust-extracted\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.870445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.870431    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32b3d943-4522-4898-90cc-b4c89db038cd-installation-pull-secrets\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.871657 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.871496    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32b3d943-4522-4898-90cc-b4c89db038cd-ca-trust-extracted\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.871892 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.871865    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32b3d943-4522-4898-90cc-b4c89db038cd-trusted-ca\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.872272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.872230    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32b3d943-4522-4898-90cc-b4c89db038cd-registry-certificates\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.875278 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.874815    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0a8d6138-c6ed-481f-93e5-dc7924b750e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-95wv7\" (UID: \"0a8d6138-c6ed-481f-93e5-dc7924b750e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:02.875278 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.875229    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32b3d943-4522-4898-90cc-b4c89db038cd-installation-pull-secrets\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.876505 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.876481    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-registry-tls\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.877002 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.876982    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32b3d943-4522-4898-90cc-b4c89db038cd-image-registry-private-configuration\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.899772 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.899754    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-bound-sa-token\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.900050 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.900033    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vq6j\" (UniqueName: \"kubernetes.io/projected/32b3d943-4522-4898-90cc-b4c89db038cd-kube-api-access-6vq6j\") pod \"image-registry-7d9f979958-4jkmx\" (UID: \"32b3d943-4522-4898-90cc-b4c89db038cd\") " pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:02.910955 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.910939    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:02.915841 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:02.915824    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:03.120093 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.120072    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-hq6r9"]
Oct 30 14:07:03.121789 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:03.121750    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50d6557_45f3_486a_abbf_466c2a92b7c1.slice/crio-9aee4a16c99bbf83750b0712bde3d98d5924686521a8fd7f3b8b1614feb49070 WatchSource:0}: Error finding container 9aee4a16c99bbf83750b0712bde3d98d5924686521a8fd7f3b8b1614feb49070: Status 404 returned error can't find the container with id 9aee4a16c99bbf83750b0712bde3d98d5924686521a8fd7f3b8b1614feb49070
Oct 30 14:07:03.205337 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.205308    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"]
Oct 30 14:07:03.209523 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:03.209499    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8d6138_c6ed_481f_93e5_dc7924b750e2.slice/crio-b1ec93e273f4532906fb09012e79b17bd6df96b7bd4268882637a305a13123ff WatchSource:0}: Error finding container b1ec93e273f4532906fb09012e79b17bd6df96b7bd4268882637a305a13123ff: Status 404 returned error can't find the container with id b1ec93e273f4532906fb09012e79b17bd6df96b7bd4268882637a305a13123ff
Oct 30 14:07:03.214827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.214808    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9f979958-4jkmx"]
Oct 30 14:07:03.219071 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:03.219049    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b3d943_4522_4898_90cc_b4c89db038cd.slice/crio-b88c5521cf58ce1f167bf3ce11c3d7acfc139422a55cd6d1f01e2fbd75a3730b WatchSource:0}: Error finding container b88c5521cf58ce1f167bf3ce11c3d7acfc139422a55cd6d1f01e2fbd75a3730b: Status 404 returned error can't find the container with id b88c5521cf58ce1f167bf3ce11c3d7acfc139422a55cd6d1f01e2fbd75a3730b
Oct 30 14:07:03.374438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.374363    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:07:03.376579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.376559    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da4b95f0-1840-4912-b202-2e49232dfac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85889\" (UID: \"da4b95f0-1840-4912-b202-2e49232dfac9\") " pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:07:03.477046 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.477007    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85889"
Oct 30 14:07:03.680849 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.680770    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx" event={"ID":"32b3d943-4522-4898-90cc-b4c89db038cd","Type":"ContainerStarted","Data":"0da8e7fb5bbbba5cc15ee866149036c7205285e1503aaca33cec88a1fd8a79ba"}
Oct 30 14:07:03.680849 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.680829    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx" event={"ID":"32b3d943-4522-4898-90cc-b4c89db038cd","Type":"ContainerStarted","Data":"b88c5521cf58ce1f167bf3ce11c3d7acfc139422a55cd6d1f01e2fbd75a3730b"}
Oct 30 14:07:03.681069 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.680879    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:03.682301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.682273    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7" event={"ID":"0a8d6138-c6ed-481f-93e5-dc7924b750e2","Type":"ContainerStarted","Data":"b1ec93e273f4532906fb09012e79b17bd6df96b7bd4268882637a305a13123ff"}
Oct 30 14:07:03.683581 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.683555    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-hq6r9" event={"ID":"a50d6557-45f3-486a-abbf-466c2a92b7c1","Type":"ContainerStarted","Data":"9aee4a16c99bbf83750b0712bde3d98d5924686521a8fd7f3b8b1614feb49070"}
Oct 30 14:07:03.728309 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.728240    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx" podStartSLOduration=1.728223221 podStartE2EDuration="1.728223221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:03.727801613 +0000 UTC m=+17.362748235" watchObservedRunningTime="2026-10-30 14:07:03.728223221 +0000 UTC m=+17.363169838"
Oct 30 14:07:03.782069 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:03.779398    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-85889"]
Oct 30 14:07:03.787540 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:03.787510    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4b95f0_1840_4912_b202_2e49232dfac9.slice/crio-de52c025733a4d7afd9fcde19d64220113b32eb02678ddab012eb6f5b8cd9337 WatchSource:0}: Error finding container de52c025733a4d7afd9fcde19d64220113b32eb02678ddab012eb6f5b8cd9337: Status 404 returned error can't find the container with id de52c025733a4d7afd9fcde19d64220113b32eb02678ddab012eb6f5b8cd9337
Oct 30 14:07:04.689201 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.689163    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7" event={"ID":"0a8d6138-c6ed-481f-93e5-dc7924b750e2","Type":"ContainerStarted","Data":"f8971104c05fb724d411d37021d0de6147c72a4c01c952acaa00c49bf62f849e"}
Oct 30 14:07:04.689576 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.689385    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:04.692081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.692049    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85889" event={"ID":"da4b95f0-1840-4912-b202-2e49232dfac9","Type":"ContainerStarted","Data":"2be25513ad8bee8b18d03849442f8c6870af9430259033df6a4b4efb23f980ba"}
Oct 30 14:07:04.692186 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.692101    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85889" event={"ID":"da4b95f0-1840-4912-b202-2e49232dfac9","Type":"ContainerStarted","Data":"b8b00b0a28f4e95b0bf536c2a75ddefba560b81969cfc859f29753bbe22de2ee"}
Oct 30 14:07:04.692186 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.692128    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85889" event={"ID":"da4b95f0-1840-4912-b202-2e49232dfac9","Type":"ContainerStarted","Data":"de52c025733a4d7afd9fcde19d64220113b32eb02678ddab012eb6f5b8cd9337"}
Oct 30 14:07:04.694947 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.694924    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7"
Oct 30 14:07:04.730733 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:04.730677    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-95wv7" podStartSLOduration=1.611430497 podStartE2EDuration="2.730657769s" totalImagesPullingTime="1.119227272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:04.72979216 +0000 UTC m=+18.364738780" watchObservedRunningTime="2026-10-30 14:07:04.730657769 +0000 UTC m=+18.365604391"
Oct 30 14:07:06.701735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:06.701669    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85889" event={"ID":"da4b95f0-1840-4912-b202-2e49232dfac9","Type":"ContainerStarted","Data":"397e58acf36b8f760464e434528931298fcc7daca54cd7e61fc7800213b80754"}
Oct 30 14:07:07.666163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:07.666129    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ws6jd"
Oct 30 14:07:11.232435 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.232055    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lhqgm"]
Oct 30 14:07:11.235802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.235781    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.294841 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.294815    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8kn7g\""
Oct 30 14:07:11.294841 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.294819    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 14:07:11.295037 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.294848    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 14:07:11.331538 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331509    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-wtmp\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331663 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331561    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331663 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331634    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-textfile\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331668    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-tls\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331689    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-root\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331707    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b627267-17c9-4b45-97d7-d6fdaa731bc2-metrics-client-ca\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331733    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhsb\" (UniqueName: \"kubernetes.io/projected/8b627267-17c9-4b45-97d7-d6fdaa731bc2-kube-api-access-6bhsb\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331756    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-sys\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.331933 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.331775    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.339992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.339968    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 14:07:11.339992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.339978    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 14:07:11.340154 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.340020    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 14:07:11.340154 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.340048    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 14:07:11.432140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432115    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-sys\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432152    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432199    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-wtmp\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432230    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432275    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-textfile\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432308    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-tls\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432332    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-root\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432360    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b627267-17c9-4b45-97d7-d6fdaa731bc2-metrics-client-ca\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432359    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-sys\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432397    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhsb\" (UniqueName: \"kubernetes.io/projected/8b627267-17c9-4b45-97d7-d6fdaa731bc2-kube-api-access-6bhsb\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432412    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-wtmp\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432431    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b627267-17c9-4b45-97d7-d6fdaa731bc2-root\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.432875 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.432843    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.433040 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.433017    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-textfile\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.433264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.433223    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b627267-17c9-4b45-97d7-d6fdaa731bc2-metrics-client-ca\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.434969 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.434948    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-tls\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.437593 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.437569    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b627267-17c9-4b45-97d7-d6fdaa731bc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.456513 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.456487    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhsb\" (UniqueName: \"kubernetes.io/projected/8b627267-17c9-4b45-97d7-d6fdaa731bc2-kube-api-access-6bhsb\") pod \"node-exporter-lhqgm\" (UID: \"8b627267-17c9-4b45-97d7-d6fdaa731bc2\") " pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.549841 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.549789    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lhqgm"
Oct 30 14:07:11.562575 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:11.562545    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b627267_17c9_4b45_97d7_d6fdaa731bc2.slice/crio-3440c94de74086b4dbffe9aa14cf0cad39becc39d078d1a51c472b3657838d6e WatchSource:0}: Error finding container 3440c94de74086b4dbffe9aa14cf0cad39becc39d078d1a51c472b3657838d6e: Status 404 returned error can't find the container with id 3440c94de74086b4dbffe9aa14cf0cad39becc39d078d1a51c472b3657838d6e
Oct 30 14:07:11.718206 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:11.718166    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhqgm" event={"ID":"8b627267-17c9-4b45-97d7-d6fdaa731bc2","Type":"ContainerStarted","Data":"3440c94de74086b4dbffe9aa14cf0cad39becc39d078d1a51c472b3657838d6e"}
Oct 30 14:07:12.723750 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:12.723467    4538 generic.go:356] "Generic (PLEG): container finished" podID="8b627267-17c9-4b45-97d7-d6fdaa731bc2" containerID="1c64da264f7217d0a088a1db40f85a418eb438b9c1c9294e067ccf09d31a4c2b" exitCode=0
Oct 30 14:07:12.723750 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:12.723572    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhqgm" event={"ID":"8b627267-17c9-4b45-97d7-d6fdaa731bc2","Type":"ContainerDied","Data":"1c64da264f7217d0a088a1db40f85a418eb438b9c1c9294e067ccf09d31a4c2b"}
Oct 30 14:07:13.494187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.494150    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"]
Oct 30 14:07:13.496826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.496806    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.512470 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.512446    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 14:07:13.515394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.515376    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 14:07:13.526409 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.526387    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"]
Oct 30 14:07:13.543977 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.543950    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544012    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544106    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-grpc-tls\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544186 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544135    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544186 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544161    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91169353-ce69-4f26-8296-4e1d7aa0efcc-metrics-client-ca\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544291 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544190    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-tls\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544289    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544325    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp48l\" (UniqueName: \"kubernetes.io/projected/91169353-ce69-4f26-8296-4e1d7aa0efcc-kube-api-access-qp48l\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.544415 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.544346    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91169353-ce69-4f26-8296-4e1d7aa0efcc-tmp\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.612754 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.612724    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 14:07:13.612905 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.612846    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-323fuqhnuslfs\""
Oct 30 14:07:13.612905 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.612870    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 14:07:13.612905 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.612884    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k2dbw\""
Oct 30 14:07:13.613043 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.612967    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 14:07:13.645356 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645326    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645500 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645359    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91169353-ce69-4f26-8296-4e1d7aa0efcc-metrics-client-ca\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645500 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645388    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-tls\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645500 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645431    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645500 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645449    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp48l\" (UniqueName: \"kubernetes.io/projected/91169353-ce69-4f26-8296-4e1d7aa0efcc-kube-api-access-qp48l\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645500 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645483    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91169353-ce69-4f26-8296-4e1d7aa0efcc-tmp\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645540    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645591    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.645739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.645612    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-grpc-tls\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.646175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.646143    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91169353-ce69-4f26-8296-4e1d7aa0efcc-tmp\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.646175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.646157    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91169353-ce69-4f26-8296-4e1d7aa0efcc-metrics-client-ca\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.648600 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.648573    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.648707 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.648657    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-grpc-tls\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.648962 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.648939    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.649065 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.649028    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.649129 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.649080    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.649634 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.649610    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/91169353-ce69-4f26-8296-4e1d7aa0efcc-secret-thanos-querier-tls\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.670527 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.670503    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp48l\" (UniqueName: \"kubernetes.io/projected/91169353-ce69-4f26-8296-4e1d7aa0efcc-kube-api-access-qp48l\") pod \"thanos-querier-69dd5dd96b-7chsp\" (UID: \"91169353-ce69-4f26-8296-4e1d7aa0efcc\") " pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:13.729702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.729668    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhqgm" event={"ID":"8b627267-17c9-4b45-97d7-d6fdaa731bc2","Type":"ContainerStarted","Data":"3e2a228edc25f4879ec682faadade3038aa3a0a3b6d0f4c901fe315db816c6cd"}
Oct 30 14:07:13.730129 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.729726    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lhqgm" event={"ID":"8b627267-17c9-4b45-97d7-d6fdaa731bc2","Type":"ContainerStarted","Data":"a3fd420132c91963fecad81864aa1cf82e764e3b2c2dffc4b80c88c227b7b26b"}
Oct 30 14:07:13.775657 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.775567    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lhqgm" podStartSLOduration=1.803659679 podStartE2EDuration="2.775551754s" totalImagesPullingTime="895.59996ms" totalInitContainerRuntime="76.292115ms" isStatefulPod=true podCreationTimestamp="2026-10-30 14:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:13.774921742 +0000 UTC m=+27.409868397" watchObservedRunningTime="2026-10-30 14:07:13.775551754 +0000 UTC m=+27.410498402"
Oct 30 14:07:13.814218 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:13.814183    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:14.149199 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:14.149167    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"]
Oct 30 14:07:14.154141 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:14.154109    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91169353_ce69_4f26_8296_4e1d7aa0efcc.slice/crio-41796dd5264496d2b00c684bc52ad2d6dadddb1f75a8a04765fcba9141e0fee5 WatchSource:0}: Error finding container 41796dd5264496d2b00c684bc52ad2d6dadddb1f75a8a04765fcba9141e0fee5: Status 404 returned error can't find the container with id 41796dd5264496d2b00c684bc52ad2d6dadddb1f75a8a04765fcba9141e0fee5
Oct 30 14:07:14.744600 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:14.744560    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"41796dd5264496d2b00c684bc52ad2d6dadddb1f75a8a04765fcba9141e0fee5"}
Oct 30 14:07:16.754479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:16.754444    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"20be67f2c81e590ed60313f622960f2fdf0367f01a43daf4d57b9aeaf5079b3a"}
Oct 30 14:07:16.754892 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:16.754515    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"9508a6ec62b5ae1900b0d973df4c0ad5098253a85ddf07c7fd856936e1975e8c"}
Oct 30 14:07:16.754892 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:16.754557    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"3b8cdcc52dea80aad621b4e570f4b35c0c825469c0a507fa76f9709d84ede21a"}
Oct 30 14:07:18.225881 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.225843    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:18.250107 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.249408    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:18.250107 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.249583    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.265439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.265417    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 14:07:18.265439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.265435    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 14:07:18.265601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.265545    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pzn99\""
Oct 30 14:07:18.268257 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.268227    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 14:07:18.269116 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.269096    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 14:07:18.277930 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.277908    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 14:07:18.278482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.278461    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 14:07:18.281047 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.281028    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 14:07:18.282426 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282401    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9wv\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282520 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282448    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282520 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282487    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282571    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282682 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282626    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282682 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282655    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282780 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282694    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282778    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282799    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282821    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282846    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282884    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282931    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.282974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.282957    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.283163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.283002    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.283163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.283076    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.283163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.283116    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.283163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.283139    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.283372 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.283231    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.283372 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.283273    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.304762 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.304693    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 14:07:18.304878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.304767    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 14:07:18.365613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.365575    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 14:07:18.365969 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.365948    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 14:07:18.365969 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.365958    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 14:07:18.366117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.366024    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cf9t74ul1rsc4\""
Oct 30 14:07:18.366117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.366060    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 14:07:18.366198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.366127    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 14:07:18.366198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.366188    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 14:07:18.383993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.383965    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384007    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384036    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384067    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9wv\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384102    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384137    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384165    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384193    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384218    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384271    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384308    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384333    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384357    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384380    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384409    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384436    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384463    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384489    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384530    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.384938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.384566    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.385144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.385119    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.385278 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.385221    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.386298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.386002    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.388235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.387123    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.388235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.387122    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.388235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.387712    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.388444 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.388411    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.390090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.390066    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.390649 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.390625    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.390899 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.390882    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.390974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.390895    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.391481 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.391458    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.392233 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.392214    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.392938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.392914    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.393366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.393339    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.393434 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.393345    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.393860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.393832    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.394034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.394013    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.394094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.394033    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.410466 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.410445    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9wv\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv\") pod \"prometheus-k8s-0\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.656681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.656456    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:18.767024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.766994    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"b5cba236f4b06f3231e280807c7ac7bf67180a78b39257abe595d1476be0eb6c"}
Oct 30 14:07:18.767172 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.767061    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"bb9989f17e4e0831763b982f130193be746b3f578c403ce67ec94b5866013844"}
Oct 30 14:07:18.767172 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.767090    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" event={"ID":"91169353-ce69-4f26-8296-4e1d7aa0efcc","Type":"ContainerStarted","Data":"78760516407f7cb37920dd7ffa522629b6f159350f7a7985823133e1c5f49ab7"}
Oct 30 14:07:18.767420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.767394    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:18.818025 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.817973    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp" podStartSLOduration=2.508883837 podStartE2EDuration="5.817956734s" totalImagesPullingTime="3.309072897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:18.817534262 +0000 UTC m=+32.452480909" watchObservedRunningTime="2026-10-30 14:07:18.817956734 +0000 UTC m=+32.452903354"
Oct 30 14:07:18.991269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:18.991192    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rksrm"
Oct 30 14:07:19.003650 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:19.003538    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:19.009172 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:19.009147    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d2e53f_d642_4a7f_aefb_535cbc962aa2.slice/crio-bdfafaa561044b9d041d954471219dd2e02e1456c088f495a6e38957e4cd8131 WatchSource:0}: Error finding container bdfafaa561044b9d041d954471219dd2e02e1456c088f495a6e38957e4cd8131: Status 404 returned error can't find the container with id bdfafaa561044b9d041d954471219dd2e02e1456c088f495a6e38957e4cd8131
Oct 30 14:07:19.773354 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:19.773066    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"bdfafaa561044b9d041d954471219dd2e02e1456c088f495a6e38957e4cd8131"}
Oct 30 14:07:19.777579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:19.777432    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-hq6r9" event={"ID":"a50d6557-45f3-486a-abbf-466c2a92b7c1","Type":"ContainerStarted","Data":"60103a93415744c91b44fab664f628f28f046a66f45973f53cc4bd18878a43f0"}
Oct 30 14:07:19.777579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:19.777519    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:19.782696 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:19.782633    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-hq6r9"
Oct 30 14:07:19.824490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:19.824432    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-hq6r9" podStartSLOduration=1.60158296 podStartE2EDuration="17.824415581s" totalImagesPullingTime="16.222832621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:19.824302458 +0000 UTC m=+33.459249080" watchObservedRunningTime="2026-10-30 14:07:19.824415581 +0000 UTC m=+33.459362196"
Oct 30 14:07:20.781892 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:20.781813    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="a87b4a594244cd6b20e28ffd5ab06ac60b8ec57e9a35902e7d6bc48e08692ed9" exitCode=0
Oct 30 14:07:20.782404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:20.781921    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"a87b4a594244cd6b20e28ffd5ab06ac60b8ec57e9a35902e7d6bc48e08692ed9"}
Oct 30 14:07:24.696727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:24.696695    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d9f979958-4jkmx"
Oct 30 14:07:24.785191 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:24.785165    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69dd5dd96b-7chsp"
Oct 30 14:07:25.808982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.808949    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"937b9a85fe6b07f766498d9d3bfbcd4ad60dc2a6e351a05b483ac34f0fbc170e"}
Oct 30 14:07:25.809440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.809026    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"1b47cd35df983f9fa06517a6998eedf5bbce75231f64108fd720be7b3010cc5a"}
Oct 30 14:07:25.809440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.809063    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"47e18396d17c5fde5ebbf9e41001daaf70db85c001f3814c6cc20abcdd43c7d1"}
Oct 30 14:07:25.809440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.809106    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"ed647116b46bbd24c820297a8a41d813a1ae29e6e46c25ac91b2f7aad5a99496"}
Oct 30 14:07:25.809440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.809134    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"b7c215e3cbe2cf85b3dfa069d869147795b833abf47eaf2e6fcb41cd4fa1c47c"}
Oct 30 14:07:25.809440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.809163    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerStarted","Data":"1a2a145907124e0542121d59e4b5d579086c124a08bb2b3f3d6869820e110ae2"}
Oct 30 14:07:25.870345 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:25.870282    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.408657977 podStartE2EDuration="7.870267692s" totalImagesPullingTime="5.439804691s" totalInitContainerRuntime="21.805024ms" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:25.869522983 +0000 UTC m=+39.504469602" watchObservedRunningTime="2026-10-30 14:07:25.870267692 +0000 UTC m=+39.505214303"
Oct 30 14:07:28.657342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:28.657267    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:29.393860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:29.393830    4538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g2tcs_4fbb0acc-a13c-4ca6-b00f-69e4c03eca15/konnectivity-agent/0.log" limit=1024
Oct 30 14:07:29.570474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:29.570442    4538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g2tcs_4fbb0acc-a13c-4ca6-b00f-69e4c03eca15/konnectivity-agent/0.log" limit=1024
Oct 30 14:07:31.618623 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:07:31.618590    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:07:34.536080 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:34.536044    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:34.585519 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:34.585494    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:34.854762 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:34.854737    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:57.778577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778542    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:57.779114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778840    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="prometheus" containerID="cri-o://1a2a145907124e0542121d59e4b5d579086c124a08bb2b3f3d6869820e110ae2" gracePeriod=600
Oct 30 14:07:57.779114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778879    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy" containerID="cri-o://1b47cd35df983f9fa06517a6998eedf5bbce75231f64108fd720be7b3010cc5a" gracePeriod=600
Oct 30 14:07:57.779114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778900    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="thanos-sidecar" containerID="cri-o://ed647116b46bbd24c820297a8a41d813a1ae29e6e46c25ac91b2f7aad5a99496" gracePeriod=600
Oct 30 14:07:57.779114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778921    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://937b9a85fe6b07f766498d9d3bfbcd4ad60dc2a6e351a05b483ac34f0fbc170e" gracePeriod=600
Oct 30 14:07:57.779114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778946    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="config-reloader" containerID="cri-o://b7c215e3cbe2cf85b3dfa069d869147795b833abf47eaf2e6fcb41cd4fa1c47c" gracePeriod=600
Oct 30 14:07:57.779114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.778989    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-web" containerID="cri-o://47e18396d17c5fde5ebbf9e41001daaf70db85c001f3814c6cc20abcdd43c7d1" gracePeriod=600
Oct 30 14:07:57.917734 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917703    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="937b9a85fe6b07f766498d9d3bfbcd4ad60dc2a6e351a05b483ac34f0fbc170e" exitCode=0
Oct 30 14:07:57.917734 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917734    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="1b47cd35df983f9fa06517a6998eedf5bbce75231f64108fd720be7b3010cc5a" exitCode=0
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917746    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="47e18396d17c5fde5ebbf9e41001daaf70db85c001f3814c6cc20abcdd43c7d1" exitCode=0
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917756    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="ed647116b46bbd24c820297a8a41d813a1ae29e6e46c25ac91b2f7aad5a99496" exitCode=0
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917768    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="b7c215e3cbe2cf85b3dfa069d869147795b833abf47eaf2e6fcb41cd4fa1c47c" exitCode=0
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917767    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"937b9a85fe6b07f766498d9d3bfbcd4ad60dc2a6e351a05b483ac34f0fbc170e"}
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917832    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"1b47cd35df983f9fa06517a6998eedf5bbce75231f64108fd720be7b3010cc5a"}
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917779    4538 generic.go:356] "Generic (PLEG): container finished" podID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerID="1a2a145907124e0542121d59e4b5d579086c124a08bb2b3f3d6869820e110ae2" exitCode=0
Oct 30 14:07:57.917873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917858    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"47e18396d17c5fde5ebbf9e41001daaf70db85c001f3814c6cc20abcdd43c7d1"}
Oct 30 14:07:57.918094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917887    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"ed647116b46bbd24c820297a8a41d813a1ae29e6e46c25ac91b2f7aad5a99496"}
Oct 30 14:07:57.918094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917911    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"b7c215e3cbe2cf85b3dfa069d869147795b833abf47eaf2e6fcb41cd4fa1c47c"}
Oct 30 14:07:57.918094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:57.917933    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"1a2a145907124e0542121d59e4b5d579086c124a08bb2b3f3d6869820e110ae2"}
Oct 30 14:07:58.052602 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.052539    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:58.217507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217470    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217514    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217543    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217573    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217597    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217629    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217671    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217711    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217751    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217779    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217815    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217845    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217877    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217905    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217944    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.217997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.217983    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.218450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.218023    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.218450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.218061    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.218450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.218091    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.218450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.218134    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1\") pod \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\" (UID: \"43d2e53f-d642-4a7f-aefb-535cbc962aa2\") "
Oct 30 14:07:58.218707 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.218682    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.218780 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.218702    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.219273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.219227    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.219985 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.219764    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:07:58.220165 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.220138    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.220282 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.220263    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.220589 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.220561    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.221063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.221018    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:07:58.221178 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.221153    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.221310 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.221290    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.221424 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.221404    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "kube-api-access-zn9wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:07:58.222322 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.222297    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:07:58.222457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.222410    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.222613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.222585    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.222820 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.222795    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.222925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.222906    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.223285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.223240    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.223893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.223869    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.223989 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.223976    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:07:58.230812 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.230792    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config" pod "43d2e53f-d642-4a7f-aefb-535cbc962aa2" (UID: "43d2e53f-d642-4a7f-aefb-535cbc962aa2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:07:58.319241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319167    4538 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319197    4538 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319207    4538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-db\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319219    4538 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-kube-rbac-proxy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319228    4538 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319236    4538 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43d2e53f-d642-4a7f-aefb-535cbc962aa2-config-out\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319262    4538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319275    4538 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319288    4538 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319302    4538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319312    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn9wv\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-kube-api-access-zn9wv\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319320    4538 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-web-config\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319328    4538 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319336    4538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319344    4538 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43d2e53f-d642-4a7f-aefb-535cbc962aa2-tls-assets\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319352    4538 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319361    4538 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-metrics-client-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319369    4538 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319378    4538 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d2e53f-d642-4a7f-aefb-535cbc962aa2-configmap-metrics-client-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.319530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.319386    4538 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43d2e53f-d642-4a7f-aefb-535cbc962aa2-secret-grpc-tls\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:07:58.924357 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.924268    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43d2e53f-d642-4a7f-aefb-535cbc962aa2","Type":"ContainerDied","Data":"bdfafaa561044b9d041d954471219dd2e02e1456c088f495a6e38957e4cd8131"}
Oct 30 14:07:58.924357 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.924352    4538 scope.go:122] "RemoveContainer" containerID="937b9a85fe6b07f766498d9d3bfbcd4ad60dc2a6e351a05b483ac34f0fbc170e"
Oct 30 14:07:58.924357 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.924355    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:58.931996 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.931981    4538 scope.go:122] "RemoveContainer" containerID="1b47cd35df983f9fa06517a6998eedf5bbce75231f64108fd720be7b3010cc5a"
Oct 30 14:07:58.938596 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.938578    4538 scope.go:122] "RemoveContainer" containerID="47e18396d17c5fde5ebbf9e41001daaf70db85c001f3814c6cc20abcdd43c7d1"
Oct 30 14:07:58.944734 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.944717    4538 scope.go:122] "RemoveContainer" containerID="ed647116b46bbd24c820297a8a41d813a1ae29e6e46c25ac91b2f7aad5a99496"
Oct 30 14:07:58.950952 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.950938    4538 scope.go:122] "RemoveContainer" containerID="b7c215e3cbe2cf85b3dfa069d869147795b833abf47eaf2e6fcb41cd4fa1c47c"
Oct 30 14:07:58.957531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.957508    4538 scope.go:122] "RemoveContainer" containerID="1a2a145907124e0542121d59e4b5d579086c124a08bb2b3f3d6869820e110ae2"
Oct 30 14:07:58.964194 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.964179    4538 scope.go:122] "RemoveContainer" containerID="a87b4a594244cd6b20e28ffd5ab06ac60b8ec57e9a35902e7d6bc48e08692ed9"
Oct 30 14:07:58.995514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:58.995484    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:59.008454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.008433    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:59.035856 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.035835    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:59.036168 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036150    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy"
Oct 30 14:07:59.036168 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036167    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036181    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="prometheus"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036186    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="prometheus"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036195    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-web"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036199    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-web"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036211    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="thanos-sidecar"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036217    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="thanos-sidecar"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036230    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="config-reloader"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036238    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="config-reloader"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036268    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="init-config-reloader"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036273    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="init-config-reloader"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036284    4538 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-thanos"
Oct 30 14:07:59.036301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036289    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-thanos"
Oct 30 14:07:59.036771 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036340    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-thanos"
Oct 30 14:07:59.036771 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036349    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy"
Oct 30 14:07:59.036771 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036356    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="prometheus"
Oct 30 14:07:59.036771 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036361    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="kube-rbac-proxy-web"
Oct 30 14:07:59.036771 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036367    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="thanos-sidecar"
Oct 30 14:07:59.036771 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.036373    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" containerName="config-reloader"
Oct 30 14:07:59.077703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.077681    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:59.077823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.077812    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.094121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.094100    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 14:07:59.094235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.094162    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pzn99\""
Oct 30 14:07:59.094235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.094205    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 14:07:59.094235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.094224    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 14:07:59.094420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.094341    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cf9t74ul1rsc4\""
Oct 30 14:07:59.094420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.094381    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 14:07:59.095180 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.095166    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 14:07:59.095340 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.095327    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 14:07:59.095414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.095359    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 14:07:59.095414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.095377    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 14:07:59.095414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.095397    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 14:07:59.095563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.095480    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 14:07:59.109925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.109889    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 14:07:59.109925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.109925    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 14:07:59.110066 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.109990    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 14:07:59.110066 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.110038    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 14:07:59.110145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.110065    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 14:07:59.226883 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.226800    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.226883 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.226837    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.226919    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.226950    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.226984    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-web-config\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227017    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227087    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c48aa324-932b-4243-b07b-adf4768e1488-config-out\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227107    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227132    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227150    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227227    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227273    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c48aa324-932b-4243-b07b-adf4768e1488-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227288    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6hx\" (UniqueName: \"kubernetes.io/projected/c48aa324-932b-4243-b07b-adf4768e1488-kube-api-access-4b6hx\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227370    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227392    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227410    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-config\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227424    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227488    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227524    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.227697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.227551    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328100    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328139    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328170    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328283    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328323    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-web-config\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328446    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328476    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c48aa324-932b-4243-b07b-adf4768e1488-config-out\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328505    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328531    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328558    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328602    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328637    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c48aa324-932b-4243-b07b-adf4768e1488-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328662    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6hx\" (UniqueName: \"kubernetes.io/projected/c48aa324-932b-4243-b07b-adf4768e1488-kube-api-access-4b6hx\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328694    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328718    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.328755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328743    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-config\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329082 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328767    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329082 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328805    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329082 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328832    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329082 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.328853    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.329195    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329451 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.329428    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.329563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.329538    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.330169 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.330136    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.331658 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.331353    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.331658 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.331351    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.331658 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.331420    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.331658 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.331552    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.332111 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.332088    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-config\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.332189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.332134    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.332485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.332457    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.332593 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.332547    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.332801 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.332780    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.334010 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.333983    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c48aa324-932b-4243-b07b-adf4768e1488-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.334102 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.334056    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.334405 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.334380    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c48aa324-932b-4243-b07b-adf4768e1488-config-out\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.334480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.334433    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-web-config\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.334480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.334466    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c48aa324-932b-4243-b07b-adf4768e1488-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.334575 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.334558    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c48aa324-932b-4243-b07b-adf4768e1488-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.356175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.356150    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6hx\" (UniqueName: \"kubernetes.io/projected/c48aa324-932b-4243-b07b-adf4768e1488-kube-api-access-4b6hx\") pod \"prometheus-k8s-0\" (UID: \"c48aa324-932b-4243-b07b-adf4768e1488\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.488977 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.488886    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:07:59.853529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.853494    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 14:07:59.857763 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:07:59.857730    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48aa324_932b_4243_b07b_adf4768e1488.slice/crio-fd38af05a9f3da539887a96dea64730d677bb9daa6e9ed09644d7000c334b725 WatchSource:0}: Error finding container fd38af05a9f3da539887a96dea64730d677bb9daa6e9ed09644d7000c334b725: Status 404 returned error can't find the container with id fd38af05a9f3da539887a96dea64730d677bb9daa6e9ed09644d7000c334b725
Oct 30 14:07:59.935187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:07:59.935151    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"fd38af05a9f3da539887a96dea64730d677bb9daa6e9ed09644d7000c334b725"}
Oct 30 14:08:00.455509 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.455460    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-sdd5w-49dtr"]
Oct 30 14:08:00.455711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.455687    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-sdd5w-49dtr" podUID="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" containerName="insights-gathering" containerID="cri-o://f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29" gracePeriod=30
Oct 30 14:08:00.579803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.579774    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43d2e53f-d642-4a7f-aefb-535cbc962aa2" path="/var/lib/kubelet/pods/43d2e53f-d642-4a7f-aefb-535cbc962aa2/volumes"
Oct 30 14:08:00.744610 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.744532    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:08:00.843762 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.843724    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") pod \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") "
Oct 30 14:08:00.843908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.843787    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") pod \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") "
Oct 30 14:08:00.843908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.843852    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") pod \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") "
Oct 30 14:08:00.843908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.843882    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") pod \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\" (UID: \"36e7afaa-96e3-4842-b1f2-32d5d1e54e74\") "
Oct 30 14:08:00.844182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.844155    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path" pod "36e7afaa-96e3-4842-b1f2-32d5d1e54e74" (UID: "36e7afaa-96e3-4842-b1f2-32d5d1e54e74"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:08:00.844221 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.844161    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle" pod "36e7afaa-96e3-4842-b1f2-32d5d1e54e74" (UID: "36e7afaa-96e3-4842-b1f2-32d5d1e54e74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:08:00.844284 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.844242    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle" pod "36e7afaa-96e3-4842-b1f2-32d5d1e54e74" (UID: "36e7afaa-96e3-4842-b1f2-32d5d1e54e74"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:08:00.846098 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.846080    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5" pod "36e7afaa-96e3-4842-b1f2-32d5d1e54e74" (UID: "36e7afaa-96e3-4842-b1f2-32d5d1e54e74"). InnerVolumeSpecName "kube-api-access-6f9d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:08:00.941142 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.941110    4538 generic.go:356] "Generic (PLEG): container finished" podID="c48aa324-932b-4243-b07b-adf4768e1488" containerID="93617451dbfe8317dbc14b8b9050759e74bb404feb7472b6c671404392fe1a8c" exitCode=0
Oct 30 14:08:00.941597 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.941202    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerDied","Data":"93617451dbfe8317dbc14b8b9050759e74bb404feb7472b6c671404392fe1a8c"}
Oct 30 14:08:00.942382 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.942329    4538 generic.go:356] "Generic (PLEG): container finished" podID="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" containerID="f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29" exitCode=2
Oct 30 14:08:00.942447 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.942385    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-sdd5w-49dtr"
Oct 30 14:08:00.942447 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.942366    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sdd5w-49dtr" event={"ID":"36e7afaa-96e3-4842-b1f2-32d5d1e54e74","Type":"ContainerDied","Data":"f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29"}
Oct 30 14:08:00.942524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.942449    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-sdd5w-49dtr" event={"ID":"36e7afaa-96e3-4842-b1f2-32d5d1e54e74","Type":"ContainerDied","Data":"045638be3eff3c740f39863931f108e4d2f1dd199f1413eccb607f20028c7c6a"}
Oct 30 14:08:00.942524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.942475    4538 scope.go:122] "RemoveContainer" containerID="f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29"
Oct 30 14:08:00.944593 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.944571    4538 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-archives-path\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:08:00.944707 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.944596    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f9d5\" (UniqueName: \"kubernetes.io/projected/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-kube-api-access-6f9d5\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:08:00.944707 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.944611    4538 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-service-ca-bundle\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:08:00.944707 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.944624    4538 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e7afaa-96e3-4842-b1f2-32d5d1e54e74-trusted-ca-bundle\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:08:00.961577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.961554    4538 scope.go:122] "RemoveContainer" containerID="f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29"
Oct 30 14:08:00.961881 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:08:00.961855    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29\": container with ID starting with f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29 not found: ID does not exist" containerID="f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29"
Oct 30 14:08:00.961947 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:00.961883    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29"} err="failed to get container status \"f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29\": rpc error: code = NotFound desc = could not find container \"f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29\": container with ID starting with f1f5b357482710e1ad6bc192594e9ced90fb6d1c6f4f6c82632b27c6584d0c29 not found: ID does not exist"
Oct 30 14:08:01.038016 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.037990    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-sdd5w-49dtr"]
Oct 30 14:08:01.043485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.043463    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-sdd5w-49dtr"]
Oct 30 14:08:01.617629 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:08:01.617596    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:08:01.949561 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.949531    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"e38c97c0a52a9d38a0d1835fbc4cd4f60b7f89e1a7ab57fc8152ee2046d482be"}
Oct 30 14:08:01.949979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.949603    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"ae1364e3d0cc5aeee7d2345a07ec77187e677846981da7c369fd2a0aa6363d19"}
Oct 30 14:08:01.949979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.949631    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"b97a0ebfc6e12cfa2a73ca822652bbcad4b83710a8fc48ce4a3ee490cb060422"}
Oct 30 14:08:01.949979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.949668    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"0a17ccfebe6f1d3d9f4c06b18308eda48e44ead00acd6e4b9df14493fa808e9d"}
Oct 30 14:08:01.949979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.949706    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"113f18b41f841bde954f43d0009cd1c04a293ff1406615ce8721e9933e735460"}
Oct 30 14:08:01.949979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:01.949744    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c48aa324-932b-4243-b07b-adf4768e1488","Type":"ContainerStarted","Data":"0ce53d506571b48238db3c48c33ea87f3ea8afe9646934660f070101375119a7"}
Oct 30 14:08:02.025400 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:02.025337    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.006245327 podStartE2EDuration="3.025316044s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.070717ms" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:08:02.02393987 +0000 UTC m=+75.658886489" watchObservedRunningTime="2026-10-30 14:08:02.025316044 +0000 UTC m=+75.660262676"
Oct 30 14:08:02.580632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:02.580596    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" path="/var/lib/kubelet/pods/36e7afaa-96e3-4842-b1f2-32d5d1e54e74/volumes"
Oct 30 14:08:04.489359 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:04.489322    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:08:31.618286 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:08:31.618229    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:08:59.489424 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:59.489345    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:08:59.503933 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:08:59.503909    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:09:00.166197 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:09:00.166172    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 14:09:01.617851 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:09:01.617815    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:09:31.617911 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:09:31.617875    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:10:01.617017 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:10:01.616985    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:10:31.618376 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:10:31.618300    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:11:01.617997 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:11:01.617960    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:11:31.618689 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:11:31.618646    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:12:01.618678 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:12:01.618602    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:12:23.431084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.431051    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"]
Oct 30 14:12:23.431563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.431342    4538 cpu_manager.go:414] "containerMap: removing container" podUID="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" containerName="insights-gathering"
Oct 30 14:12:23.431563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.431354    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" containerName="insights-gathering"
Oct 30 14:12:23.431563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.431413    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="36e7afaa-96e3-4842-b1f2-32d5d1e54e74" containerName="insights-gathering"
Oct 30 14:12:23.433222 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.433207    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.466359 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.466332    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"]
Oct 30 14:12:23.508945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.508920    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 14:12:23.509208 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.509189    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 14:12:23.509385 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.509368    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 14:12:23.509385 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.509377    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 14:12:23.509490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.509404    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\""
Oct 30 14:12:23.509490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.509453    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6f7bn\""
Oct 30 14:12:23.547371 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.547345    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-webhook-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.547471 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.547373    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5bjh\" (UniqueName: \"kubernetes.io/projected/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-kube-api-access-q5bjh\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.547515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.547479    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-tmp\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.547548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.547510    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.547581 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.547559    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-manifests\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.547613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.547576    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-metrics-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648289    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-webhook-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648318    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5bjh\" (UniqueName: \"kubernetes.io/projected/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-kube-api-access-q5bjh\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648367    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-tmp\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648384    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648402    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-manifests\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648592 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648419    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-metrics-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.648895 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.648860    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-manifests\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.650627 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.650607    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-tmp\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.650774 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.650756    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-webhook-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.651201 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.651186    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-metrics-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.651286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.651240    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.673507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.673488    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5bjh\" (UniqueName: \"kubernetes.io/projected/f4f605bf-761a-42a3-a87d-35aa1c8cbb81-kube-api-access-q5bjh\") pod \"opendatahub-operator-controller-manager-6749b785b4-ncf7k\" (UID: \"f4f605bf-761a-42a3-a87d-35aa1c8cbb81\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:23.745255 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:23.745194    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:24.104955 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:24.104925    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"]
Oct 30 14:12:24.108509 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:12:24.108482    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f605bf_761a_42a3_a87d_35aa1c8cbb81.slice/crio-7ac5bed24756a97feb453990b1a9e18b4d4dc38c74875352f9385d7e0d509ea5 WatchSource:0}: Error finding container 7ac5bed24756a97feb453990b1a9e18b4d4dc38c74875352f9385d7e0d509ea5: Status 404 returned error can't find the container with id 7ac5bed24756a97feb453990b1a9e18b4d4dc38c74875352f9385d7e0d509ea5
Oct 30 14:12:24.110339 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:24.110318    4538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 14:12:24.828672 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:24.828621    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k" event={"ID":"f4f605bf-761a-42a3-a87d-35aa1c8cbb81","Type":"ContainerStarted","Data":"7ac5bed24756a97feb453990b1a9e18b4d4dc38c74875352f9385d7e0d509ea5"}
Oct 30 14:12:27.841553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:27.841513    4538 generic.go:356] "Generic (PLEG): container finished" podID="f4f605bf-761a-42a3-a87d-35aa1c8cbb81" containerID="f2b2dbc1af07c324f7c7b99c66c91ec76775dd4be672fb021b66f205e32121fa" exitCode=0
Oct 30 14:12:27.841911 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:27.841590    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k" event={"ID":"f4f605bf-761a-42a3-a87d-35aa1c8cbb81","Type":"ContainerDied","Data":"f2b2dbc1af07c324f7c7b99c66c91ec76775dd4be672fb021b66f205e32121fa"}
Oct 30 14:12:28.847566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:28.847527    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k" event={"ID":"f4f605bf-761a-42a3-a87d-35aa1c8cbb81","Type":"ContainerStarted","Data":"74b3a6d886097e8d8df32f5c60a093863187401b5f67cab3dbd21c4d9e7c3da7"}
Oct 30 14:12:28.847983 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:28.847662    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:28.955797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:28.955717    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k" podStartSLOduration=2.410304557 podStartE2EDuration="5.955695882s" totalImagesPullingTime="3.064462798s" totalInitContainerRuntime="480.928527ms" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:28.942381841 +0000 UTC m=+342.577328461" watchObservedRunningTime="2026-10-30 14:12:28.955695882 +0000 UTC m=+342.590642502"
Oct 30 14:12:31.618523 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:12:31.618483    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:12:39.854264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:39.854212    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-ncf7k"
Oct 30 14:12:41.296380 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.296350    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"]
Oct 30 14:12:41.303743 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.303720    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.319390 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.319363    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"]
Oct 30 14:12:41.383571 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.383541    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a7f68c1-b82e-48b9-a465-632757e8dbbc-manager-config\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.383709 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.383587    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a7f68c1-b82e-48b9-a465-632757e8dbbc-cert\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.383709 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.383656    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85rl6\" (UniqueName: \"kubernetes.io/projected/5a7f68c1-b82e-48b9-a465-632757e8dbbc-kube-api-access-85rl6\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.383709 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.383680    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a7f68c1-b82e-48b9-a465-632757e8dbbc-metrics-cert\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.403998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.403975    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Oct 30 14:12:41.404078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.404028    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xjrbd\""
Oct 30 14:12:41.404078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.404046    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Oct 30 14:12:41.404210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.404192    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Oct 30 14:12:41.404300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.404231    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Oct 30 14:12:41.404300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.404234    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Oct 30 14:12:41.484874 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.484854    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a7f68c1-b82e-48b9-a465-632757e8dbbc-manager-config\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.484966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.484889    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a7f68c1-b82e-48b9-a465-632757e8dbbc-cert\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.484966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.484918    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85rl6\" (UniqueName: \"kubernetes.io/projected/5a7f68c1-b82e-48b9-a465-632757e8dbbc-kube-api-access-85rl6\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.484966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.484938    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a7f68c1-b82e-48b9-a465-632757e8dbbc-metrics-cert\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.485582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.485565    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5a7f68c1-b82e-48b9-a465-632757e8dbbc-manager-config\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.487459 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.487433    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a7f68c1-b82e-48b9-a465-632757e8dbbc-metrics-cert\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.487536 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.487508    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a7f68c1-b82e-48b9-a465-632757e8dbbc-cert\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.509076 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.509049    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85rl6\" (UniqueName: \"kubernetes.io/projected/5a7f68c1-b82e-48b9-a465-632757e8dbbc-kube-api-access-85rl6\") pod \"lws-controller-manager-5ffcfd7c54-xbtsf\" (UID: \"5a7f68c1-b82e-48b9-a465-632757e8dbbc\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.614474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.614444    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:41.912381 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:41.912286    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"]
Oct 30 14:12:41.916289 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:12:41.916264    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7f68c1_b82e_48b9_a465_632757e8dbbc.slice/crio-d32a199cab1082647919a86d595f6f0c202b2a600f452caae3f6ecf641e86e9f WatchSource:0}: Error finding container d32a199cab1082647919a86d595f6f0c202b2a600f452caae3f6ecf641e86e9f: Status 404 returned error can't find the container with id d32a199cab1082647919a86d595f6f0c202b2a600f452caae3f6ecf641e86e9f
Oct 30 14:12:42.900239 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:42.900201    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf" event={"ID":"5a7f68c1-b82e-48b9-a465-632757e8dbbc","Type":"ContainerStarted","Data":"d32a199cab1082647919a86d595f6f0c202b2a600f452caae3f6ecf641e86e9f"}
Oct 30 14:12:44.908828 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:44.908794    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf" event={"ID":"5a7f68c1-b82e-48b9-a465-632757e8dbbc","Type":"ContainerStarted","Data":"efe85afb8aa199f30dce956f2a860dedbc7ac64a66bbdac0cf51443406572722"}
Oct 30 14:12:44.909242 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:44.908930    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:12:44.963013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:44.962961    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf" podStartSLOduration=1.371461823 podStartE2EDuration="3.962947653s" totalImagesPullingTime="2.59148583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:44.961885134 +0000 UTC m=+358.596831754" watchObservedRunningTime="2026-10-30 14:12:44.962947653 +0000 UTC m=+358.597894273"
Oct 30 14:12:46.944062 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:46.944031    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-observability-584f99c788-rq544"]
Oct 30 14:12:46.948683 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:46.948661    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:46.967745 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:46.967715    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-observability-584f99c788-rq544"]
Oct 30 14:12:46.979436 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:46.979416    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-observability-webhook-cert\""
Oct 30 14:12:46.979436 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:46.979432    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-observability-dockercfg-tcb62\""
Oct 30 14:12:47.032341 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.032311    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/4c4123f9-5539-4844-b796-1d270ae365a8-webhook-certs\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.032493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.032348    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdj7\" (UniqueName: \"kubernetes.io/projected/4c4123f9-5539-4844-b796-1d270ae365a8-kube-api-access-cfdj7\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.132898 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.132866    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/4c4123f9-5539-4844-b796-1d270ae365a8-webhook-certs\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.133056 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.132906    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdj7\" (UniqueName: \"kubernetes.io/projected/4c4123f9-5539-4844-b796-1d270ae365a8-kube-api-access-cfdj7\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.133056 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:12:47.133026    4538 secret.go:189] Couldn't get secret opendatahub/odh-observability-webhook-cert: secret "odh-observability-webhook-cert" not found
Oct 30 14:12:47.133125 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:12:47.133092    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4123f9-5539-4844-b796-1d270ae365a8-webhook-certs podName:4c4123f9-5539-4844-b796-1d270ae365a8 nodeName:}" failed. No retries permitted until 2026-10-30 14:12:47.633073854 +0000 UTC m=+361.268020454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/4c4123f9-5539-4844-b796-1d270ae365a8-webhook-certs") pod "odh-observability-584f99c788-rq544" (UID: "4c4123f9-5539-4844-b796-1d270ae365a8") : secret "odh-observability-webhook-cert" not found
Oct 30 14:12:47.158259 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.158231    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdj7\" (UniqueName: \"kubernetes.io/projected/4c4123f9-5539-4844-b796-1d270ae365a8-kube-api-access-cfdj7\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.637052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.637017    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/4c4123f9-5539-4844-b796-1d270ae365a8-webhook-certs\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.639479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.639455    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/4c4123f9-5539-4844-b796-1d270ae365a8-webhook-certs\") pod \"odh-observability-584f99c788-rq544\" (UID: \"4c4123f9-5539-4844-b796-1d270ae365a8\") " pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:47.860414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:47.860370    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:48.159386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:48.159258    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-observability-584f99c788-rq544"]
Oct 30 14:12:48.163428 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:12:48.163380    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4123f9_5539_4844_b796_1d270ae365a8.slice/crio-a051cc831b2ae9981cb538c2cede91e0661c1566af93cdbca5963c11b9b05402 WatchSource:0}: Error finding container a051cc831b2ae9981cb538c2cede91e0661c1566af93cdbca5963c11b9b05402: Status 404 returned error can't find the container with id a051cc831b2ae9981cb538c2cede91e0661c1566af93cdbca5963c11b9b05402
Oct 30 14:12:48.927711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:48.927671    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-observability-584f99c788-rq544" event={"ID":"4c4123f9-5539-4844-b796-1d270ae365a8","Type":"ContainerStarted","Data":"a051cc831b2ae9981cb538c2cede91e0661c1566af93cdbca5963c11b9b05402"}
Oct 30 14:12:49.466552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.466511    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"]
Oct 30 14:12:49.470464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.470437    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.505691 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.505662    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 14:12:49.505859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.505727    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 14:12:49.505859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.505753    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 14:12:49.507505 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.507472    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"]
Oct 30 14:12:49.544121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.544093    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7s68f\""
Oct 30 14:12:49.554437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554362    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554405    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25778f1-11cd-43ed-9432-7a7aa5256d06-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554489    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554551    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554583    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-data\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554612    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6wtm\" (UniqueName: \"kubernetes.io/projected/e25778f1-11cd-43ed-9432-7a7aa5256d06-kube-api-access-q6wtm\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554650    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554676    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-token\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.554974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.554721    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.655758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.655718    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.655935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.655773    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-data\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.655935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.655794    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6wtm\" (UniqueName: \"kubernetes.io/projected/e25778f1-11cd-43ed-9432-7a7aa5256d06-kube-api-access-q6wtm\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656055 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.655970    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656055 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656003    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-token\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656153 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656051    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656153 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656096    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656153 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656119    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25778f1-11cd-43ed-9432-7a7aa5256d06-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656153 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656140    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656192    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-data\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656286    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656492 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656441    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656542 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656506    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.656716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.656688    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25778f1-11cd-43ed-9432-7a7aa5256d06-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.658588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.658543    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.659148 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.659126    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.680925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.680901    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6wtm\" (UniqueName: \"kubernetes.io/projected/e25778f1-11cd-43ed-9432-7a7aa5256d06-kube-api-access-q6wtm\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.681042 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.680910    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25778f1-11cd-43ed-9432-7a7aa5256d06-istio-token\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-gh9bt\" (UID: \"e25778f1-11cd-43ed-9432-7a7aa5256d06\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:49.785803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:49.785720    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:50.113778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:50.113695    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"]
Oct 30 14:12:50.119988 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:12:50.119958    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25778f1_11cd_43ed_9432_7a7aa5256d06.slice/crio-c3d2dcf7790d26cfe9ef54b75503b44323774a49cdc3d60bb7d9ac55404a1a5d WatchSource:0}: Error finding container c3d2dcf7790d26cfe9ef54b75503b44323774a49cdc3d60bb7d9ac55404a1a5d: Status 404 returned error can't find the container with id c3d2dcf7790d26cfe9ef54b75503b44323774a49cdc3d60bb7d9ac55404a1a5d
Oct 30 14:12:50.942729 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:50.942597    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt" event={"ID":"e25778f1-11cd-43ed-9432-7a7aa5256d06","Type":"ContainerStarted","Data":"c3d2dcf7790d26cfe9ef54b75503b44323774a49cdc3d60bb7d9ac55404a1a5d"}
Oct 30 14:12:50.946123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:50.945277    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-observability-584f99c788-rq544" event={"ID":"4c4123f9-5539-4844-b796-1d270ae365a8","Type":"ContainerStarted","Data":"801fee9c0fa84acf8a8e3835e2d43bee8c22ddbb1b8cd128b15063a4f682aa2e"}
Oct 30 14:12:50.946123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:50.946064    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:12:52.878839 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:52.878806    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:12:52.879120 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:52.878875    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:12:52.879120 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:52.878900    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:12:53.962148 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:53.962117    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt" event={"ID":"e25778f1-11cd-43ed-9432-7a7aa5256d06","Type":"ContainerStarted","Data":"b6e19fcab9a9e455077140ddc78ef28e8cf05b5f7ea5327c1fcac66c7b568ff2"}
Oct 30 14:12:54.023827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:54.023777    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-observability-584f99c788-rq544" podStartSLOduration=5.592329616 podStartE2EDuration="8.023764437s" totalImagesPullingTime="2.431434821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:50.991283648 +0000 UTC m=+364.626230268" watchObservedRunningTime="2026-10-30 14:12:54.023764437 +0000 UTC m=+367.658711057"
Oct 30 14:12:54.024086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:54.024044    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt" podStartSLOduration=2.268260067 podStartE2EDuration="5.024033098s" totalImagesPullingTime="2.755773031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:54.023149149 +0000 UTC m=+367.658095769" watchObservedRunningTime="2026-10-30 14:12:54.024033098 +0000 UTC m=+367.658979719"
Oct 30 14:12:54.786557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:54.786524    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:54.791106 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:54.791081    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:54.965672 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:54.965631    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:54.966625 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:54.966604    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-gh9bt"
Oct 30 14:12:55.915188 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:12:55.915162    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-xbtsf"
Oct 30 14:13:01.618441 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:13:01.618409    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:13:02.959837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:02.959806    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-observability-584f99c788-rq544"
Oct 30 14:13:31.618507 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:13:31.618426    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:13:49.080770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.080732    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-sbm82"]
Oct 30 14:13:49.084384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.084363    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.106182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.106158    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-sbm82"]
Oct 30 14:13:49.137241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.137207    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"]
Oct 30 14:13:49.140351 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.140331    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.142716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.142695    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 14:13:49.142862 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.142849    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gmhtt\""
Oct 30 14:13:49.149016 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.148992    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb5a8af1-f7a1-4dbd-b618-242b3fce0509-cert\") pod \"kserve-controller-manager-776cc66d47-sbm82\" (UID: \"cb5a8af1-f7a1-4dbd-b618-242b3fce0509\") " pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.149131 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.149112    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtvfz\" (UniqueName: \"kubernetes.io/projected/cb5a8af1-f7a1-4dbd-b618-242b3fce0509-kube-api-access-gtvfz\") pod \"kserve-controller-manager-776cc66d47-sbm82\" (UID: \"cb5a8af1-f7a1-4dbd-b618-242b3fce0509\") " pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.162040 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.162018    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"]
Oct 30 14:13:49.195870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.195836    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-prdsg"]
Oct 30 14:13:49.198917 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.198896    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.222187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.222163    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-prdsg"]
Oct 30 14:13:49.238972 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.238943    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-d8f8x\""
Oct 30 14:13:49.239088 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.239010    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rhbnk\""
Oct 30 14:13:49.239088 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.239059    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 14:13:49.239167 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.239099    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 14:13:49.250384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.250357    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pww6f\" (UniqueName: \"kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f\") pod \"llmisvc-controller-manager-869d5dcc5d-jdpdn\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.250384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.250385    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h5xt\" (UniqueName: \"kubernetes.io/projected/a4c0b636-c8f9-41c5-9dc2-09149172687b-kube-api-access-7h5xt\") pod \"model-serving-api-75bd89fdfc-prdsg\" (UID: \"a4c0b636-c8f9-41c5-9dc2-09149172687b\") " pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.250554 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.250425    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtvfz\" (UniqueName: \"kubernetes.io/projected/cb5a8af1-f7a1-4dbd-b618-242b3fce0509-kube-api-access-gtvfz\") pod \"kserve-controller-manager-776cc66d47-sbm82\" (UID: \"cb5a8af1-f7a1-4dbd-b618-242b3fce0509\") " pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.250611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.250559    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-jdpdn\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.250664 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.250613    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb5a8af1-f7a1-4dbd-b618-242b3fce0509-cert\") pod \"kserve-controller-manager-776cc66d47-sbm82\" (UID: \"cb5a8af1-f7a1-4dbd-b618-242b3fce0509\") " pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.250720 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.250659    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c0b636-c8f9-41c5-9dc2-09149172687b-tls-certs\") pod \"model-serving-api-75bd89fdfc-prdsg\" (UID: \"a4c0b636-c8f9-41c5-9dc2-09149172687b\") " pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.251712 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.251691    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-sgfw5"]
Oct 30 14:13:49.253236 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.253214    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb5a8af1-f7a1-4dbd-b618-242b3fce0509-cert\") pod \"kserve-controller-manager-776cc66d47-sbm82\" (UID: \"cb5a8af1-f7a1-4dbd-b618-242b3fce0509\") " pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.254926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.254908    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.277324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.277303    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtvfz\" (UniqueName: \"kubernetes.io/projected/cb5a8af1-f7a1-4dbd-b618-242b3fce0509-kube-api-access-gtvfz\") pod \"kserve-controller-manager-776cc66d47-sbm82\" (UID: \"cb5a8af1-f7a1-4dbd-b618-242b3fce0509\") " pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.277872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.277852    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-sgfw5"]
Oct 30 14:13:49.336966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.336945    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7lpzg\""
Oct 30 14:13:49.337102 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.336949    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 14:13:49.337102 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.336956    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 14:13:49.351344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351318    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c0b636-c8f9-41c5-9dc2-09149172687b-tls-certs\") pod \"model-serving-api-75bd89fdfc-prdsg\" (UID: \"a4c0b636-c8f9-41c5-9dc2-09149172687b\") " pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.351456 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351376    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pww6f\" (UniqueName: \"kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f\") pod \"llmisvc-controller-manager-869d5dcc5d-jdpdn\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.351456 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351405    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5xt\" (UniqueName: \"kubernetes.io/projected/a4c0b636-c8f9-41c5-9dc2-09149172687b-kube-api-access-7h5xt\") pod \"model-serving-api-75bd89fdfc-prdsg\" (UID: \"a4c0b636-c8f9-41c5-9dc2-09149172687b\") " pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.351456 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351450    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtxt\" (UniqueName: \"kubernetes.io/projected/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-kube-api-access-vmtxt\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.351590 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351506    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-cert\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.351670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351639    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-metrics-certs\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.351720 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.351690    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-jdpdn\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.353731 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.353711    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4c0b636-c8f9-41c5-9dc2-09149172687b-tls-certs\") pod \"model-serving-api-75bd89fdfc-prdsg\" (UID: \"a4c0b636-c8f9-41c5-9dc2-09149172687b\") " pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.353950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.353929    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-jdpdn\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.376931 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.376906    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5xt\" (UniqueName: \"kubernetes.io/projected/a4c0b636-c8f9-41c5-9dc2-09149172687b-kube-api-access-7h5xt\") pod \"model-serving-api-75bd89fdfc-prdsg\" (UID: \"a4c0b636-c8f9-41c5-9dc2-09149172687b\") " pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.377032 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.377011    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pww6f\" (UniqueName: \"kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f\") pod \"llmisvc-controller-manager-869d5dcc5d-jdpdn\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.396232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.396209    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:49.452453 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.452234    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:49.452562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.452509    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtxt\" (UniqueName: \"kubernetes.io/projected/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-kube-api-access-vmtxt\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.452622 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.452586    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-cert\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.452678 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.452640    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-metrics-certs\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.459716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.459694    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-metrics-certs\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.461474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.461452    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-cert\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.478015 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.477978    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtxt\" (UniqueName: \"kubernetes.io/projected/813b27f2-67b6-4cde-b0cd-78c20ae36a3d-kube-api-access-vmtxt\") pod \"odh-model-controller-f87fcf56c-sgfw5\" (UID: \"813b27f2-67b6-4cde-b0cd-78c20ae36a3d\") " pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.512472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.512178    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:49.570496 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.570468    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:49.690058 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.690016    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-sbm82"]
Oct 30 14:13:49.693687 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:13:49.693659    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5a8af1_f7a1_4dbd_b618_242b3fce0509.slice/crio-85a035112a73e892b923162400ab62bfc88438e243e673b1bb14f6baca29bdc9 WatchSource:0}: Error finding container 85a035112a73e892b923162400ab62bfc88438e243e673b1bb14f6baca29bdc9: Status 404 returned error can't find the container with id 85a035112a73e892b923162400ab62bfc88438e243e673b1bb14f6baca29bdc9
Oct 30 14:13:49.752205 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.752171    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"]
Oct 30 14:13:49.755424 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:13:49.755392    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb32e3c72_add9_4760_90cd_f5ffb6471f80.slice/crio-049a0623236758b2c7352f48985c6e5b0aea708b1e4422f8c3b6fbb23e8ddee9 WatchSource:0}: Error finding container 049a0623236758b2c7352f48985c6e5b0aea708b1e4422f8c3b6fbb23e8ddee9: Status 404 returned error can't find the container with id 049a0623236758b2c7352f48985c6e5b0aea708b1e4422f8c3b6fbb23e8ddee9
Oct 30 14:13:49.814495 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.814466    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-prdsg"]
Oct 30 14:13:49.818003 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:13:49.817981    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c0b636_c8f9_41c5_9dc2_09149172687b.slice/crio-7988a76cc9e957d0c23901dc975d591e2c5e821495f499706bc18384627a8a5a WatchSource:0}: Error finding container 7988a76cc9e957d0c23901dc975d591e2c5e821495f499706bc18384627a8a5a: Status 404 returned error can't find the container with id 7988a76cc9e957d0c23901dc975d591e2c5e821495f499706bc18384627a8a5a
Oct 30 14:13:49.874590 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:49.874563    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-f87fcf56c-sgfw5"]
Oct 30 14:13:49.878796 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:13:49.878765    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813b27f2_67b6_4cde_b0cd_78c20ae36a3d.slice/crio-b275333a53a198a8564ee60e7124e3e15421431d3d19e1cb0b1c43cbdcc5ce98 WatchSource:0}: Error finding container b275333a53a198a8564ee60e7124e3e15421431d3d19e1cb0b1c43cbdcc5ce98: Status 404 returned error can't find the container with id b275333a53a198a8564ee60e7124e3e15421431d3d19e1cb0b1c43cbdcc5ce98
Oct 30 14:13:50.177529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:50.177456    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn" event={"ID":"b32e3c72-add9-4760-90cd-f5ffb6471f80","Type":"ContainerStarted","Data":"049a0623236758b2c7352f48985c6e5b0aea708b1e4422f8c3b6fbb23e8ddee9"}
Oct 30 14:13:50.178895 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:50.178865    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg" event={"ID":"a4c0b636-c8f9-41c5-9dc2-09149172687b","Type":"ContainerStarted","Data":"7988a76cc9e957d0c23901dc975d591e2c5e821495f499706bc18384627a8a5a"}
Oct 30 14:13:50.180190 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:50.180159    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5" event={"ID":"813b27f2-67b6-4cde-b0cd-78c20ae36a3d","Type":"ContainerStarted","Data":"b275333a53a198a8564ee60e7124e3e15421431d3d19e1cb0b1c43cbdcc5ce98"}
Oct 30 14:13:50.181457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:50.181426    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82" event={"ID":"cb5a8af1-f7a1-4dbd-b618-242b3fce0509","Type":"ContainerStarted","Data":"85a035112a73e892b923162400ab62bfc88438e243e673b1bb14f6baca29bdc9"}
Oct 30 14:13:53.204641 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:53.204559    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg" event={"ID":"a4c0b636-c8f9-41c5-9dc2-09149172687b","Type":"ContainerStarted","Data":"f92ca770266576b661c79ef31502adc42174535b63fda267648c28d8e812420f"}
Oct 30 14:13:53.205209 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:53.205190    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:13:53.249583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:53.249511    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg" podStartSLOduration=1.188131805 podStartE2EDuration="4.249492769s" totalImagesPullingTime="3.061360964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:13:53.248432851 +0000 UTC m=+426.883379497" watchObservedRunningTime="2026-10-30 14:13:53.249492769 +0000 UTC m=+426.884439390"
Oct 30 14:13:54.209626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:54.209582    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82" event={"ID":"cb5a8af1-f7a1-4dbd-b618-242b3fce0509","Type":"ContainerStarted","Data":"8f4df741cdab2bbc2bf1e282ff5f7f119a30497a76a0ab2440da9988e5469abd"}
Oct 30 14:13:54.210043 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:54.209649    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:13:54.211181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:54.211150    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5" event={"ID":"813b27f2-67b6-4cde-b0cd-78c20ae36a3d","Type":"ContainerStarted","Data":"d49bac44f5869189ad0101e44ad1d4ecfac2de16b2c9e59bab6da2fdbee494b6"}
Oct 30 14:13:54.256434 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:54.256392    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82" podStartSLOduration=0.882279254 podStartE2EDuration="5.256378894s" totalImagesPullingTime="4.37409964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:13:54.255587639 +0000 UTC m=+427.890534260" watchObservedRunningTime="2026-10-30 14:13:54.256378894 +0000 UTC m=+427.891325492"
Oct 30 14:13:54.299503 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:54.299455    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5" podStartSLOduration=1.101643417 podStartE2EDuration="5.299437257s" totalImagesPullingTime="4.19779384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:13:54.298675269 +0000 UTC m=+427.933621888" watchObservedRunningTime="2026-10-30 14:13:54.299437257 +0000 UTC m=+427.934383881"
Oct 30 14:13:55.216130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:55.216094    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn" event={"ID":"b32e3c72-add9-4760-90cd-f5ffb6471f80","Type":"ContainerStarted","Data":"405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542"}
Oct 30 14:13:55.216588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:55.216343    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:13:55.216588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:55.216548    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:13:55.259261 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:13:55.259205    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn" podStartSLOduration=1.897636205 podStartE2EDuration="6.259192774s" totalImagesPullingTime="4.361556569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:13:55.258411422 +0000 UTC m=+428.893358042" watchObservedRunningTime="2026-10-30 14:13:55.259192774 +0000 UTC m=+428.894139393"
Oct 30 14:14:01.619676 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:14:01.619639    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:14:05.220420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:14:05.220391    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-prdsg"
Oct 30 14:14:06.223533 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:14:06.223502    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-f87fcf56c-sgfw5"
Oct 30 14:14:25.221463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:14:25.221435    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-sbm82"
Oct 30 14:14:27.227577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:14:27.227545    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:14:31.618863 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:14:31.618831    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:15:01.617890 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:15:01.617805    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:15:29.088305 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.088269    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"]
Oct 30 14:15:29.092183 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.092159    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:29.126859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.126805    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 14:15:29.127013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.126871    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cp2bc\""
Oct 30 14:15:29.127013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.126945    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 14:15:29.128513 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.128492    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"]
Oct 30 14:15:29.191703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.191676    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdb46\" (UniqueName: \"kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46\") pod \"limitador-operator-controller-manager-856dd584c5-4kjpn\" (UID: \"805d87d6-e623-4cff-9287-f1bbdaabefa2\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:29.292990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.292964    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdb46\" (UniqueName: \"kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46\") pod \"limitador-operator-controller-manager-856dd584c5-4kjpn\" (UID: \"805d87d6-e623-4cff-9287-f1bbdaabefa2\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:29.323467 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.323433    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdb46\" (UniqueName: \"kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46\") pod \"limitador-operator-controller-manager-856dd584c5-4kjpn\" (UID: \"805d87d6-e623-4cff-9287-f1bbdaabefa2\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:29.412939 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.412872    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:29.715854 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:29.715773    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"]
Oct 30 14:15:29.719205 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:15:29.719174    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805d87d6_e623_4cff_9287_f1bbdaabefa2.slice/crio-d06fa86132982d3bd82ccee4c86f1ced86d00b6384abce98b21c33cd2431f12b WatchSource:0}: Error finding container d06fa86132982d3bd82ccee4c86f1ced86d00b6384abce98b21c33cd2431f12b: Status 404 returned error can't find the container with id d06fa86132982d3bd82ccee4c86f1ced86d00b6384abce98b21c33cd2431f12b
Oct 30 14:15:30.592621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:30.592586    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn" event={"ID":"805d87d6-e623-4cff-9287-f1bbdaabefa2","Type":"ContainerStarted","Data":"d06fa86132982d3bd82ccee4c86f1ced86d00b6384abce98b21c33cd2431f12b"}
Oct 30 14:15:31.624863 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:15:31.624823    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:15:32.604264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:32.604214    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn" event={"ID":"805d87d6-e623-4cff-9287-f1bbdaabefa2","Type":"ContainerStarted","Data":"36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c"}
Oct 30 14:15:32.604429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:32.604316    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:32.648401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:32.648342    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn" podStartSLOduration=1.23128021 podStartE2EDuration="3.648329196s" totalImagesPullingTime="2.417048986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:15:32.647156155 +0000 UTC m=+526.282102775" watchObservedRunningTime="2026-10-30 14:15:32.648329196 +0000 UTC m=+526.283275794"
Oct 30 14:15:43.610428 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:43.610393    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:52.319687 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.319650    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"]
Oct 30 14:15:52.320113 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.319922    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" containerName="manager" containerID="cri-o://36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c" gracePeriod=2
Oct 30 14:15:52.336572 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.335608    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"]
Oct 30 14:15:52.348209 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.348182    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"]
Oct 30 14:15:52.348701 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.348684    4538 cpu_manager.go:414] "containerMap: removing container" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" containerName="manager"
Oct 30 14:15:52.348744 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.348704    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" containerName="manager"
Oct 30 14:15:52.348830 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.348819    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" containerName="manager"
Oct 30 14:15:52.353964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.353944    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:15:52.368007 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:15:52.367979    4538 status_manager.go:1045] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-856dd584c5-4kjpn\" is forbidden: User \"system:node:ip-10-0-132-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-7.ec2.internal' and this object" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:52.376413 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.376385    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"]
Oct 30 14:15:52.486495 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.486459    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5dm\" (UniqueName: \"kubernetes.io/projected/b5563654-5419-449c-944b-48cd6a44f279-kube-api-access-qf5dm\") pod \"limitador-operator-controller-manager-856dd584c5-9nm6p\" (UID: \"b5563654-5419-449c-944b-48cd6a44f279\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:15:52.571343 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.571299    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:52.585584 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:15:52.585559    4538 status_manager.go:1045] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-856dd584c5-4kjpn\" is forbidden: User \"system:node:ip-10-0-132-7.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-7.ec2.internal' and this object" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:52.586886 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.586864    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5dm\" (UniqueName: \"kubernetes.io/projected/b5563654-5419-449c-944b-48cd6a44f279-kube-api-access-qf5dm\") pod \"limitador-operator-controller-manager-856dd584c5-9nm6p\" (UID: \"b5563654-5419-449c-944b-48cd6a44f279\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:15:52.613049 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.613027    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5dm\" (UniqueName: \"kubernetes.io/projected/b5563654-5419-449c-944b-48cd6a44f279-kube-api-access-qf5dm\") pod \"limitador-operator-controller-manager-856dd584c5-9nm6p\" (UID: \"b5563654-5419-449c-944b-48cd6a44f279\") " pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:15:52.681185 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.681158    4538 generic.go:356] "Generic (PLEG): container finished" podID="805d87d6-e623-4cff-9287-f1bbdaabefa2" containerID="36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c" exitCode=0
Oct 30 14:15:52.681308 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.681200    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-4kjpn"
Oct 30 14:15:52.681308 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.681272    4538 scope.go:122] "RemoveContainer" containerID="36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c"
Oct 30 14:15:52.687399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.687380    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46\" (UniqueName: \"kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46\") pod \"805d87d6-e623-4cff-9287-f1bbdaabefa2\" (UID: \"805d87d6-e623-4cff-9287-f1bbdaabefa2\") "
Oct 30 14:15:52.689090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.689076    4538 scope.go:122] "RemoveContainer" containerID="36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c"
Oct 30 14:15:52.689362 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:15:52.689343    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c\": container with ID starting with 36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c not found: ID does not exist" containerID="36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c"
Oct 30 14:15:52.689431 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.689370    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c"} err="failed to get container status \"36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c\": rpc error: code = NotFound desc = could not find container \"36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c\": container with ID starting with 36f9a43d317af74b2a288067b76f74429231cf1c0d5e8e8c63b8dd6631db118c not found: ID does not exist"
Oct 30 14:15:52.689478 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.689456    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46" pod "805d87d6-e623-4cff-9287-f1bbdaabefa2" (UID: "805d87d6-e623-4cff-9287-f1bbdaabefa2"). InnerVolumeSpecName "kube-api-access-hdb46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:15:52.697597 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.697575    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:15:52.788569 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:52.788541    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdb46\" (UniqueName: \"kubernetes.io/projected/805d87d6-e623-4cff-9287-f1bbdaabefa2-kube-api-access-hdb46\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:15:53.020925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:53.020892    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"]
Oct 30 14:15:53.024618 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:15:53.024594    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5563654_5419_449c_944b_48cd6a44f279.slice/crio-752fc87e318b6d58ef579de25238388bebc7a222bf777ec2c6359082d259fd10 WatchSource:0}: Error finding container 752fc87e318b6d58ef579de25238388bebc7a222bf777ec2c6359082d259fd10: Status 404 returned error can't find the container with id 752fc87e318b6d58ef579de25238388bebc7a222bf777ec2c6359082d259fd10
Oct 30 14:15:53.687282 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:53.687224    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p" event={"ID":"b5563654-5419-449c-944b-48cd6a44f279","Type":"ContainerStarted","Data":"1d392f55a6997a3d48517baec5fa0136b67cc2cc73a43b0eedc37de8ecd10fe3"}
Oct 30 14:15:53.687680 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:53.687298    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p" event={"ID":"b5563654-5419-449c-944b-48cd6a44f279","Type":"ContainerStarted","Data":"752fc87e318b6d58ef579de25238388bebc7a222bf777ec2c6359082d259fd10"}
Oct 30 14:15:53.687680 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:53.687335    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:15:53.735676 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:53.735631    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p" podStartSLOduration=1.735618708 podStartE2EDuration="1.735618708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:15:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:15:53.734987618 +0000 UTC m=+547.369934237" watchObservedRunningTime="2026-10-30 14:15:53.735618708 +0000 UTC m=+547.370565327"
Oct 30 14:15:54.580661 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:15:54.580620    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="805d87d6-e623-4cff-9287-f1bbdaabefa2" path="/var/lib/kubelet/pods/805d87d6-e623-4cff-9287-f1bbdaabefa2/volumes"
Oct 30 14:16:01.618356 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:16:01.618320    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:16:04.694398 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:04.694367    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-856dd584c5-9nm6p"
Oct 30 14:16:22.091877 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.091840    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"]
Oct 30 14:16:22.095889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.095865    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.112289 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.112271    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sx525\""
Oct 30 14:16:22.125990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.125967    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"]
Oct 30 14:16:22.129054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129028    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8mwc\" (UniqueName: \"kubernetes.io/projected/54a14e56-a813-4999-a1a3-c10fa3099a41-kube-api-access-b8mwc\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129134 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129077    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129162    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a14e56-a813-4999-a1a3-c10fa3099a41-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129221 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129188    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129221 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129209    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129234    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129404    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129433    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.129587 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.129458    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230112    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230147    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230162    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230181    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8mwc\" (UniqueName: \"kubernetes.io/projected/54a14e56-a813-4999-a1a3-c10fa3099a41-kube-api-access-b8mwc\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230207    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230240    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a14e56-a813-4999-a1a3-c10fa3099a41-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230289    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230317    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230349    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230742 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230599    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230742 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230666    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230914 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230892    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.230966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.230939    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.231027 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.231006    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a14e56-a813-4999-a1a3-c10fa3099a41-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.233088 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.233062    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.233348 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.233325    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.254777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.254753    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a14e56-a813-4999-a1a3-c10fa3099a41-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.254871 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.254846    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8mwc\" (UniqueName: \"kubernetes.io/projected/54a14e56-a813-4999-a1a3-c10fa3099a41-kube-api-access-b8mwc\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-fkwsg\" (UID: \"54a14e56-a813-4999-a1a3-c10fa3099a41\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.410057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.409978    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:22.726058 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.725950    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"]
Oct 30 14:16:22.730708 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:16:22.730684    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a14e56_a813_4999_a1a3_c10fa3099a41.slice/crio-ea471fec2cd3748972a56603287f2eab0f439ace45ef44d48ecd418615d605a9 WatchSource:0}: Error finding container ea471fec2cd3748972a56603287f2eab0f439ace45ef44d48ecd418615d605a9: Status 404 returned error can't find the container with id ea471fec2cd3748972a56603287f2eab0f439ace45ef44d48ecd418615d605a9
Oct 30 14:16:22.732702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.732668    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:16:22.732795 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.732747    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:16:22.732795 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.732788    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:16:22.805223 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:22.805193    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" event={"ID":"54a14e56-a813-4999-a1a3-c10fa3099a41","Type":"ContainerStarted","Data":"ea471fec2cd3748972a56603287f2eab0f439ace45ef44d48ecd418615d605a9"}
Oct 30 14:16:23.810824 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:23.810783    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" event={"ID":"54a14e56-a813-4999-a1a3-c10fa3099a41","Type":"ContainerStarted","Data":"a1049273e7dec2cd74b0f1a339d3edf546e11a25ff20988f3a5bb7b8c2b9eb01"}
Oct 30 14:16:23.872578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:23.872536    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podStartSLOduration=1.872522852 podStartE2EDuration="1.872522852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:16:23.871466537 +0000 UTC m=+577.506413155" watchObservedRunningTime="2026-10-30 14:16:23.872522852 +0000 UTC m=+577.507469472"
Oct 30 14:16:24.411153 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:24.411121    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:24.415865 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:24.415840    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:24.814730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:24.814639    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:24.815495 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:16:24.815461    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:16:31.618781 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:16:31.618677    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:17:01.618959 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:17:01.618919    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:17:22.990744 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:22.990712    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"]
Oct 30 14:17:22.993956 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:22.993935    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.011673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.011647    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 14:17:23.011673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.011658    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-vj4t6\""
Oct 30 14:17:23.024582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.024557    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 14:17:23.025189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.025171    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 14:17:23.027218 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.027194    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"]
Oct 30 14:17:23.045123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.045096    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/87430a8a-1756-4d40-8f50-88f27a0d660f-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.045226 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.045150    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6zxd\" (UniqueName: \"kubernetes.io/projected/87430a8a-1756-4d40-8f50-88f27a0d660f-kube-api-access-s6zxd\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.045293 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.045237    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87430a8a-1756-4d40-8f50-88f27a0d660f-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.045335 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.045287    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87430a8a-1756-4d40-8f50-88f27a0d660f-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.146112 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.146080    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6zxd\" (UniqueName: \"kubernetes.io/projected/87430a8a-1756-4d40-8f50-88f27a0d660f-kube-api-access-s6zxd\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.146324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.146122    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87430a8a-1756-4d40-8f50-88f27a0d660f-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.146324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.146145    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87430a8a-1756-4d40-8f50-88f27a0d660f-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.146324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.146202    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/87430a8a-1756-4d40-8f50-88f27a0d660f-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.146324 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:17:23.146290    4538 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found
Oct 30 14:17:23.146521 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:17:23.146366    4538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87430a8a-1756-4d40-8f50-88f27a0d660f-tls-cert podName:87430a8a-1756-4d40-8f50-88f27a0d660f nodeName:}" failed. No retries permitted until 2026-10-30 14:17:23.646345242 +0000 UTC m=+637.281291867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/87430a8a-1756-4d40-8f50-88f27a0d660f-tls-cert") pod "usage-logs-tenancy-proxy-7d94f55f4b-cf4z9" (UID: "87430a8a-1756-4d40-8f50-88f27a0d660f") : secret "usage-logs-tenancy-proxy-tls" not found
Oct 30 14:17:23.146872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.146853    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87430a8a-1756-4d40-8f50-88f27a0d660f-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.146991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.146972    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/87430a8a-1756-4d40-8f50-88f27a0d660f-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.172667 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.172638    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6zxd\" (UniqueName: \"kubernetes.io/projected/87430a8a-1756-4d40-8f50-88f27a0d660f-kube-api-access-s6zxd\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.649023 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.648980    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87430a8a-1756-4d40-8f50-88f27a0d660f-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.651316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.651298    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87430a8a-1756-4d40-8f50-88f27a0d660f-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-cf4z9\" (UID: \"87430a8a-1756-4d40-8f50-88f27a0d660f\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:23.909836 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:23.909752    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:24.206306 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:24.206206    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"]
Oct 30 14:17:24.210640 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:17:24.210613    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87430a8a_1756_4d40_8f50_88f27a0d660f.slice/crio-a86c4d7fac64c77068d1edd206b67682a18d2c778b61134f406d02a337c0719f WatchSource:0}: Error finding container a86c4d7fac64c77068d1edd206b67682a18d2c778b61134f406d02a337c0719f: Status 404 returned error can't find the container with id a86c4d7fac64c77068d1edd206b67682a18d2c778b61134f406d02a337c0719f
Oct 30 14:17:24.212774 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:24.212756    4538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 14:17:25.063816 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:25.063781    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9" event={"ID":"87430a8a-1756-4d40-8f50-88f27a0d660f","Type":"ContainerStarted","Data":"a86c4d7fac64c77068d1edd206b67682a18d2c778b61134f406d02a337c0719f"}
Oct 30 14:17:31.622092 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:17:31.622053    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:17:35.122735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:35.122700    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9" event={"ID":"87430a8a-1756-4d40-8f50-88f27a0d660f","Type":"ContainerStarted","Data":"5fed8580f664568f9295e53abe4eb282c468483f22f2a475e79cbdb2735f0fd5"}
Oct 30 14:17:35.123166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:35.122815    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:17:35.168524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:35.168479    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9" podStartSLOduration=3.137038052 podStartE2EDuration="13.168467134s" totalImagesPullingTime="10.031429082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:17:35.167845933 +0000 UTC m=+648.802792566" watchObservedRunningTime="2026-10-30 14:17:35.168467134 +0000 UTC m=+648.803413754"
Oct 30 14:17:46.133859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:17:46.133824    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-cf4z9"
Oct 30 14:18:00.663381 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.663337    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"]
Oct 30 14:18:00.671540 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.671517    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.686215 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.686189    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"]
Oct 30 14:18:00.699571 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.699543    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqdlv\" (UniqueName: \"kubernetes.io/projected/57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a-kube-api-access-cqdlv\") pod \"llmisvc-controller-manager-6466c554d8-xwt9p\" (UID: \"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.699717 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.699696    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a-cert\") pod \"llmisvc-controller-manager-6466c554d8-xwt9p\" (UID: \"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.800916 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.800870    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a-cert\") pod \"llmisvc-controller-manager-6466c554d8-xwt9p\" (UID: \"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.801074 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.800978    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqdlv\" (UniqueName: \"kubernetes.io/projected/57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a-kube-api-access-cqdlv\") pod \"llmisvc-controller-manager-6466c554d8-xwt9p\" (UID: \"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.803311 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.803286    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a-cert\") pod \"llmisvc-controller-manager-6466c554d8-xwt9p\" (UID: \"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.825929 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.825903    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqdlv\" (UniqueName: \"kubernetes.io/projected/57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a-kube-api-access-cqdlv\") pod \"llmisvc-controller-manager-6466c554d8-xwt9p\" (UID: \"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:00.986817 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:00.986741    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:01.315748 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:01.315660    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"]
Oct 30 14:18:01.319275 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:18:01.319228    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c96af4_2913_4e9a_bfe8_bd6f20c5eb0a.slice/crio-b1c061a576be746d5bd989cf91058f7eae391f6c7a2b37888e2e1b7a0e6bee58 WatchSource:0}: Error finding container b1c061a576be746d5bd989cf91058f7eae391f6c7a2b37888e2e1b7a0e6bee58: Status 404 returned error can't find the container with id b1c061a576be746d5bd989cf91058f7eae391f6c7a2b37888e2e1b7a0e6bee58
Oct 30 14:18:01.619414 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:18:01.619381    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:18:02.238219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:02.238132    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p" event={"ID":"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a","Type":"ContainerStarted","Data":"56e428f69bfa4fae75619b41488b6736eef8fe1a5fc43e31450767f0295f7451"}
Oct 30 14:18:02.238219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:02.238196    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p" event={"ID":"57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a","Type":"ContainerStarted","Data":"b1c061a576be746d5bd989cf91058f7eae391f6c7a2b37888e2e1b7a0e6bee58"}
Oct 30 14:18:02.238609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:02.238310    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:02.282053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:02.281996    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p" podStartSLOduration=1.719133025 podStartE2EDuration="2.28197966s" totalImagesPullingTime="562.846635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:18:02.281634982 +0000 UTC m=+675.916581605" watchObservedRunningTime="2026-10-30 14:18:02.28197966 +0000 UTC m=+675.916926281"
Oct 30 14:18:03.244417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:03.244385    4538 generic.go:356] "Generic (PLEG): container finished" podID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerID="a1049273e7dec2cd74b0f1a339d3edf546e11a25ff20988f3a5bb7b8c2b9eb01" exitCode=0
Oct 30 14:18:03.244877 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:03.244455    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" event={"ID":"54a14e56-a813-4999-a1a3-c10fa3099a41","Type":"ContainerDied","Data":"a1049273e7dec2cd74b0f1a339d3edf546e11a25ff20988f3a5bb7b8c2b9eb01"}
Oct 30 14:18:03.244975 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:03.244956    4538 scope.go:122] "RemoveContainer" containerID="a1049273e7dec2cd74b0f1a339d3edf546e11a25ff20988f3a5bb7b8c2b9eb01"
Oct 30 14:18:03.245935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:03.245908    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:18:03.246026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:03.245986    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:18:03.246087 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:03.246034    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:18:04.254457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:04.254420    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" event={"ID":"54a14e56-a813-4999-a1a3-c10fa3099a41","Type":"ContainerStarted","Data":"0bc8a5d7be78705803f1c151cbee5b5022f188b8bcdb97a5e337a924d9bd772c"}
Oct 30 14:18:04.410640 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:04.410610    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:18:04.410935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:04.410907    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Oct 30 14:18:04.410995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:04.410970    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Oct 30 14:18:05.411072 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:05.411038    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Oct 30 14:18:05.411581 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:05.411109    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Oct 30 14:18:06.410666 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:06.410632    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Oct 30 14:18:06.410827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:06.410688    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Oct 30 14:18:07.411315 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:07.411281    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Oct 30 14:18:07.411701 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:07.411343    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Oct 30 14:18:08.415325 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:08.415288    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Oct 30 14:18:08.415806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:08.415337    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Oct 30 14:18:09.414219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:09.414192    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:18:09.414604 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:09.414584    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:18:09.415092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:09.415074    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg"
Oct 30 14:18:31.618947 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:18:31.618906    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:18:33.247494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.247453    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xwt9p"
Oct 30 14:18:33.326151 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.326117    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"]
Oct 30 14:18:33.326429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.326394    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn" podUID="b32e3c72-add9-4760-90cd-f5ffb6471f80" containerName="manager" containerID="cri-o://405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542" gracePeriod=30
Oct 30 14:18:33.571833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.571810    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:18:33.696089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.696051    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f\" (UniqueName: \"kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f\") pod \"b32e3c72-add9-4760-90cd-f5ffb6471f80\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") "
Oct 30 14:18:33.696296 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.696117    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert\" (UniqueName: \"kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert\") pod \"b32e3c72-add9-4760-90cd-f5ffb6471f80\" (UID: \"b32e3c72-add9-4760-90cd-f5ffb6471f80\") "
Oct 30 14:18:33.698374 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.698343    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert" pod "b32e3c72-add9-4760-90cd-f5ffb6471f80" (UID: "b32e3c72-add9-4760-90cd-f5ffb6471f80"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:18:33.698493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.698410    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f" pod "b32e3c72-add9-4760-90cd-f5ffb6471f80" (UID: "b32e3c72-add9-4760-90cd-f5ffb6471f80"). InnerVolumeSpecName "kube-api-access-pww6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:18:33.797163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.797121    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pww6f\" (UniqueName: \"kubernetes.io/projected/b32e3c72-add9-4760-90cd-f5ffb6471f80-kube-api-access-pww6f\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:18:33.797163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:33.797151    4538 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b32e3c72-add9-4760-90cd-f5ffb6471f80-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:18:34.386449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.386414    4538 generic.go:356] "Generic (PLEG): container finished" podID="b32e3c72-add9-4760-90cd-f5ffb6471f80" containerID="405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542" exitCode=0
Oct 30 14:18:34.386860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.386464    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"
Oct 30 14:18:34.386860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.386490    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn" event={"ID":"b32e3c72-add9-4760-90cd-f5ffb6471f80","Type":"ContainerDied","Data":"405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542"}
Oct 30 14:18:34.386860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.386531    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn" event={"ID":"b32e3c72-add9-4760-90cd-f5ffb6471f80","Type":"ContainerDied","Data":"049a0623236758b2c7352f48985c6e5b0aea708b1e4422f8c3b6fbb23e8ddee9"}
Oct 30 14:18:34.386860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.386552    4538 scope.go:122] "RemoveContainer" containerID="405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542"
Oct 30 14:18:34.395401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.395382    4538 scope.go:122] "RemoveContainer" containerID="405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542"
Oct 30 14:18:34.395679 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:18:34.395660    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542\": container with ID starting with 405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542 not found: ID does not exist" containerID="405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542"
Oct 30 14:18:34.395727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.395688    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542"} err="failed to get container status \"405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542\": rpc error: code = NotFound desc = could not find container \"405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542\": container with ID starting with 405302451abe99cfabeb553102ffe51648cbf7287c1c619ab3a695c635d54542 not found: ID does not exist"
Oct 30 14:18:34.446797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.446754    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"]
Oct 30 14:18:34.459497 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.459462    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-jdpdn"]
Oct 30 14:18:34.580981 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:18:34.580953    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b32e3c72-add9-4760-90cd-f5ffb6471f80" path="/var/lib/kubelet/pods/b32e3c72-add9-4760-90cd-f5ffb6471f80/volumes"
Oct 30 14:19:01.619933 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:19:01.619886    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:19:31.619303 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:19:31.619215    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:19:38.297383 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.297344    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"]
Oct 30 14:19:38.298014 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.297702    4538 cpu_manager.go:414] "containerMap: removing container" podUID="b32e3c72-add9-4760-90cd-f5ffb6471f80" containerName="manager"
Oct 30 14:19:38.298014 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.297712    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b32e3c72-add9-4760-90cd-f5ffb6471f80" containerName="manager"
Oct 30 14:19:38.298014 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.297778    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="b32e3c72-add9-4760-90cd-f5ffb6471f80" containerName="manager"
Oct 30 14:19:38.300897 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.300877    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.315820 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.315794    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"]
Oct 30 14:19:38.319104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.319083    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.329727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.329698    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"]
Oct 30 14:19:38.343703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.343673    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"]
Oct 30 14:19:38.477695 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477656    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/670c8f63-b654-485f-a6d3-85113e8114d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.477861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477701    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.477861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477782    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2hp\" (UniqueName: \"kubernetes.io/projected/670c8f63-b654-485f-a6d3-85113e8114d4-kube-api-access-6f2hp\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.477861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477806    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.477861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477826    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.477861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477843    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/670c8f63-b654-485f-a6d3-85113e8114d4-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.478038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477901    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.478038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.477989    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478023    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478132 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478073    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/670c8f63-b654-485f-a6d3-85113e8114d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.478132 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478094    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478196 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478147    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478196 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478173    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478200    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478221    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57985a6e-e239-4297-a32f-f7fc2283fefd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478237    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrzn\" (UniqueName: \"kubernetes.io/projected/57985a6e-e239-4297-a32f-f7fc2283fefd-kube-api-access-8hrzn\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.478394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478317    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.478394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.478350    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.579627 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579542    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.579627 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579578    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.579627 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579600    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57985a6e-e239-4297-a32f-f7fc2283fefd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.579627 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579625    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrzn\" (UniqueName: \"kubernetes.io/projected/57985a6e-e239-4297-a32f-f7fc2283fefd-kube-api-access-8hrzn\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.579945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579668    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.579945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579695    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.579945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579724    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/670c8f63-b654-485f-a6d3-85113e8114d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.579945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579756    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579951    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2hp\" (UniqueName: \"kubernetes.io/projected/670c8f63-b654-485f-a6d3-85113e8114d4-kube-api-access-6f2hp\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.579998    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580030    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580032    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580076    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/670c8f63-b654-485f-a6d3-85113e8114d4-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580098    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580113    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580147    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580160    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580191    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580224    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/670c8f63-b654-485f-a6d3-85113e8114d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580283    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580345    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580450    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580483    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.580827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580626    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.580827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580717    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.581027 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.580994    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.581189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.581053    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/670c8f63-b654-485f-a6d3-85113e8114d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.581638 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.581616    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57985a6e-e239-4297-a32f-f7fc2283fefd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.582494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.582469    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/670c8f63-b654-485f-a6d3-85113e8114d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.582825 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.582805    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.583587 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.583566    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.583642 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.583566    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/670c8f63-b654-485f-a6d3-85113e8114d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.607092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.607057    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/670c8f63-b654-485f-a6d3-85113e8114d4-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.607344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.607326    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57985a6e-e239-4297-a32f-f7fc2283fefd-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.607414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.607338    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrzn\" (UniqueName: \"kubernetes.io/projected/57985a6e-e239-4297-a32f-f7fc2283fefd-kube-api-access-8hrzn\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-l2258\" (UID: \"57985a6e-e239-4297-a32f-f7fc2283fefd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.607414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.607339    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2hp\" (UniqueName: \"kubernetes.io/projected/670c8f63-b654-485f-a6d3-85113e8114d4-kube-api-access-6f2hp\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-svls9\" (UID: \"670c8f63-b654-485f-a6d3-85113e8114d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.613263 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.613229    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:38.634492 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.634466    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:38.949700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.949666    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"]
Oct 30 14:19:38.952835 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.952810    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"]
Oct 30 14:19:38.954458 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:19:38.954430    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57985a6e_e239_4297_a32f_f7fc2283fefd.slice/crio-a6f07718fede540373e283b08b0b12bf8df23db05b896a3fa2f708339cf6bc67 WatchSource:0}: Error finding container a6f07718fede540373e283b08b0b12bf8df23db05b896a3fa2f708339cf6bc67: Status 404 returned error can't find the container with id a6f07718fede540373e283b08b0b12bf8df23db05b896a3fa2f708339cf6bc67
Oct 30 14:19:38.956977 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:19:38.956486    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670c8f63_b654_485f_a6d3_85113e8114d4.slice/crio-47069a66b0a2f562942032bc05bdb6f00bcd356de86fb56acbed484a22681c05 WatchSource:0}: Error finding container 47069a66b0a2f562942032bc05bdb6f00bcd356de86fb56acbed484a22681c05: Status 404 returned error can't find the container with id 47069a66b0a2f562942032bc05bdb6f00bcd356de86fb56acbed484a22681c05
Oct 30 14:19:38.956977 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.956628    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:19:38.956977 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.956684    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:19:38.956977 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.956712    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:19:38.958809 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.958771    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:19:38.958929 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.958904    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:19:38.959016 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:38.958995    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:19:39.677100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:39.677068    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" event={"ID":"670c8f63-b654-485f-a6d3-85113e8114d4","Type":"ContainerStarted","Data":"bae374cc6b13e3eb2dea2116df629df05aa3c78160b877f5b9d14877cfbf3573"}
Oct 30 14:19:39.677506 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:39.677431    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" event={"ID":"670c8f63-b654-485f-a6d3-85113e8114d4","Type":"ContainerStarted","Data":"47069a66b0a2f562942032bc05bdb6f00bcd356de86fb56acbed484a22681c05"}
Oct 30 14:19:39.678575 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:39.678551    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" event={"ID":"57985a6e-e239-4297-a32f-f7fc2283fefd","Type":"ContainerStarted","Data":"ba91d754abf43630906e47cc7f7cc6c774a4e179cd7f3770323c414ada22fda8"}
Oct 30 14:19:39.678622 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:39.678592    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" event={"ID":"57985a6e-e239-4297-a32f-f7fc2283fefd","Type":"ContainerStarted","Data":"a6f07718fede540373e283b08b0b12bf8df23db05b896a3fa2f708339cf6bc67"}
Oct 30 14:19:39.756270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:39.742544    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podStartSLOduration=1.7425242490000001 podStartE2EDuration="1.742524249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:39.740022841 +0000 UTC m=+773.374969461" watchObservedRunningTime="2026-10-30 14:19:39.742524249 +0000 UTC m=+773.377470870"
Oct 30 14:19:39.792295 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:39.792137    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podStartSLOduration=1.792124133 podStartE2EDuration="1.792124133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:39.790827141 +0000 UTC m=+773.425773761" watchObservedRunningTime="2026-10-30 14:19:39.792124133 +0000 UTC m=+773.427070753"
Oct 30 14:19:40.613834 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:40.613802    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:40.615284 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:40.615263    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-l2258 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Oct 30 14:19:40.615338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:40.615322    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podUID="57985a6e-e239-4297-a32f-f7fc2283fefd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Oct 30 14:19:40.644370 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:40.644301    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:40.649474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:40.649354    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-svls9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 14:19:40.649474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:40.649413    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podUID="670c8f63-b654-485f-a6d3-85113e8114d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 14:19:41.614485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:41.614429    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-l2258 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Oct 30 14:19:41.614977 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:41.614503    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podUID="57985a6e-e239-4297-a32f-f7fc2283fefd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Oct 30 14:19:41.647272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:41.646357    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-svls9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 14:19:41.647272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:41.646419    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podUID="670c8f63-b654-485f-a6d3-85113e8114d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 14:19:42.614124 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:42.614089    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-l2258 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Oct 30 14:19:42.614332 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:42.614140    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podUID="57985a6e-e239-4297-a32f-f7fc2283fefd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Oct 30 14:19:42.641210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:42.641177    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-svls9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 14:19:42.641829 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:42.641797    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podUID="670c8f63-b654-485f-a6d3-85113e8114d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 14:19:43.613579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:43.613547    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-l2258 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Oct 30 14:19:43.613754 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:43.613598    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podUID="57985a6e-e239-4297-a32f-f7fc2283fefd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Oct 30 14:19:43.648272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:43.638627    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-svls9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 14:19:43.648272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:43.638705    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podUID="670c8f63-b654-485f-a6d3-85113e8114d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 14:19:44.614621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:44.614584    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-l2258 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Oct 30 14:19:44.614799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:44.614642    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podUID="57985a6e-e239-4297-a32f-f7fc2283fefd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Oct 30 14:19:44.648408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:44.648367    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-svls9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 14:19:44.649007 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:44.648971    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podUID="670c8f63-b654-485f-a6d3-85113e8114d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 14:19:45.614115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:45.614073    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-l2258 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Oct 30 14:19:45.614316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:45.614144    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258" podUID="57985a6e-e239-4297-a32f-f7fc2283fefd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Oct 30 14:19:45.635315 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:45.635280    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-svls9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Oct 30 14:19:45.635446 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:45.635342    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9" podUID="670c8f63-b654-485f-a6d3-85113e8114d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Oct 30 14:19:47.321260 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:47.321209    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:47.322023 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:47.321997    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:47.322760 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:47.322740    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-svls9"
Oct 30 14:19:47.325911 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:47.325894    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:47.326183 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:47.326163    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:19:47.326930 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:19:47.326913    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-l2258"
Oct 30 14:20:01.619451 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:20:01.619413    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:20:22.319475 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.319439    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"]
Oct 30 14:20:22.323430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.323409    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.340393 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.340362    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-7bf15f\""
Oct 30 14:20:22.342586 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.342556    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"]
Oct 30 14:20:22.416398 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.416353    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.416591 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.416436    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztjfm\" (UniqueName: \"kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm\") pod \"payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.518070 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.518028    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.518275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.518116    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztjfm\" (UniqueName: \"kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm\") pod \"payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.519325 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.519288    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.543632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.543593    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztjfm\" (UniqueName: \"kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm\") pod \"payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.636698 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.636659    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:22.934068 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:22.933981    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"]
Oct 30 14:20:22.938351 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:22.938322    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a86e21_1d17_4d0b_8e73_0d3afaead401.slice/crio-4ada1f260827050677d540ed10c3be8131bc60c7beb56735599d49aaf2da49a7 WatchSource:0}: Error finding container 4ada1f260827050677d540ed10c3be8131bc60c7beb56735599d49aaf2da49a7: Status 404 returned error can't find the container with id 4ada1f260827050677d540ed10c3be8131bc60c7beb56735599d49aaf2da49a7
Oct 30 14:20:23.871167 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:23.871129    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" event={"ID":"31a86e21-1d17-4d0b-8e73-0d3afaead401","Type":"ContainerStarted","Data":"4ada1f260827050677d540ed10c3be8131bc60c7beb56735599d49aaf2da49a7"}
Oct 30 14:20:24.075746 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.075707    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"]
Oct 30 14:20:24.079687 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.079660    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.098115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.098087    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"]
Oct 30 14:20:24.108306 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.108279    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-bf8266\""
Oct 30 14:20:24.108524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.108506    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-bf8266-dockercfg-898jw\""
Oct 30 14:20:24.137154 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.137074    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b72bb\" (UniqueName: \"kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb\") pod \"payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.137310 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.137283    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.238342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.238301    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.238539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.238373    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72bb\" (UniqueName: \"kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb\") pod \"payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.239078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.239052    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.265542 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.265505    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b72bb\" (UniqueName: \"kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb\") pod \"payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.394759 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.394673    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:24.706666 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.706595    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"]
Oct 30 14:20:24.711113 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:24.711082    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2edd8c5_2b47_4af3_909a_883ae54f1f16.slice/crio-dac66f428108b782448b1ba0e8ce43e7f28ff392f9639eaab78925cad3e5f618 WatchSource:0}: Error finding container dac66f428108b782448b1ba0e8ce43e7f28ff392f9639eaab78925cad3e5f618: Status 404 returned error can't find the container with id dac66f428108b782448b1ba0e8ce43e7f28ff392f9639eaab78925cad3e5f618
Oct 30 14:20:24.878566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:24.878504    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" event={"ID":"e2edd8c5-2b47-4af3-909a-883ae54f1f16","Type":"ContainerStarted","Data":"dac66f428108b782448b1ba0e8ce43e7f28ff392f9639eaab78925cad3e5f618"}
Oct 30 14:20:25.078993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.078963    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"]
Oct 30 14:20:25.084277 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.084231    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.104718 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.104688    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"]
Oct 30 14:20:25.112535 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.112506    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-24dfd7-dockercfg-n5fk7\""
Oct 30 14:20:25.112676 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.112547    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-24dfd7\""
Oct 30 14:20:25.148473 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.148157    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgl9d\" (UniqueName: \"kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d\") pod \"payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.148473 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.148317    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.249636 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.249607    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.249760 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.249676    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgl9d\" (UniqueName: \"kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d\") pod \"payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.250588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.250563    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.279278 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.277868    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgl9d\" (UniqueName: \"kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d\") pod \"payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.416223 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.416187    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.718973 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.718934    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"]
Oct 30 14:20:25.726097 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:25.726062    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1da9a0_5caa_492e_8582_1514ae933085.slice/crio-3aec025dc0f4f084f10fe3446584d147cdf3b4dfa5791ef278738bc202defcae WatchSource:0}: Error finding container 3aec025dc0f4f084f10fe3446584d147cdf3b4dfa5791ef278738bc202defcae: Status 404 returned error can't find the container with id 3aec025dc0f4f084f10fe3446584d147cdf3b4dfa5791ef278738bc202defcae
Oct 30 14:20:25.884786 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.884747    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" event={"ID":"31a86e21-1d17-4d0b-8e73-0d3afaead401","Type":"ContainerStarted","Data":"0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3"}
Oct 30 14:20:25.885234 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.884873    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:25.886556 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.886532    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" event={"ID":"3d1da9a0-5caa-492e-8582-1514ae933085","Type":"ContainerStarted","Data":"b347cb3984fe65060b39c743dddedb2b10b1ff63281c285e02741565da08a0a2"}
Oct 30 14:20:25.886693 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.886580    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" event={"ID":"3d1da9a0-5caa-492e-8582-1514ae933085","Type":"ContainerStarted","Data":"3aec025dc0f4f084f10fe3446584d147cdf3b4dfa5791ef278738bc202defcae"}
Oct 30 14:20:25.886693 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.886602    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:25.888108 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.888084    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" event={"ID":"e2edd8c5-2b47-4af3-909a-883ae54f1f16","Type":"ContainerStarted","Data":"1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f"}
Oct 30 14:20:25.888231 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.888211    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:25.929104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.929053    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" podStartSLOduration=1.8175355450000001 podStartE2EDuration="3.929038637s" totalImagesPullingTime="2.111503092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:25.927824969 +0000 UTC m=+819.562771588" watchObservedRunningTime="2026-10-30 14:20:25.929038637 +0000 UTC m=+819.563985255"
Oct 30 14:20:25.971849 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:25.971724    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" podStartSLOduration=0.971705149 podStartE2EDuration="971.705149ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:25.970168301 +0000 UTC m=+819.605114921" watchObservedRunningTime="2026-10-30 14:20:25.971705149 +0000 UTC m=+819.606651768"
Oct 30 14:20:26.015796 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.015753    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"]
Oct 30 14:20:26.020524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.020493    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.020690 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.020539    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" podStartSLOduration=1.493458495 podStartE2EDuration="2.020525424s" totalImagesPullingTime="527.066929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:26.018807358 +0000 UTC m=+819.653753979" watchObservedRunningTime="2026-10-30 14:20:26.020525424 +0000 UTC m=+819.655472044"
Oct 30 14:20:26.037437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.037403    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"]
Oct 30 14:20:26.054886 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.054854    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6src\" (UniqueName: \"kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src\") pod \"payload-processing-e2e-worker-w1-717995-5659766595-d9jq5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.055077 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.054897    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-717995-5659766595-d9jq5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.092568 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.092537    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-717995\""
Oct 30 14:20:26.092568 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.092592    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-717995-dockercfg-k6nnt\""
Oct 30 14:20:26.155835 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.155787    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6src\" (UniqueName: \"kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src\") pod \"payload-processing-e2e-worker-w1-717995-5659766595-d9jq5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.155835 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.155830    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-717995-5659766595-d9jq5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.156803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.156764    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-717995-5659766595-d9jq5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.194819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.194787    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6src\" (UniqueName: \"kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src\") pod \"payload-processing-e2e-worker-w1-717995-5659766595-d9jq5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.333528 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.333488    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.632429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.632351    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"]
Oct 30 14:20:26.635901 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:26.635871    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80676b23_b068_42e5_a539_1b8e3154d7a5.slice/crio-e6557d8922bdfe1cf423fc2aecf906ce9c3bb4e875e87e45bae0fc7a74735f84 WatchSource:0}: Error finding container e6557d8922bdfe1cf423fc2aecf906ce9c3bb4e875e87e45bae0fc7a74735f84: Status 404 returned error can't find the container with id e6557d8922bdfe1cf423fc2aecf906ce9c3bb4e875e87e45bae0fc7a74735f84
Oct 30 14:20:26.893941 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.893813    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" event={"ID":"80676b23-b068-42e5-a539-1b8e3154d7a5","Type":"ContainerStarted","Data":"a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84"}
Oct 30 14:20:26.894406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.894193    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:26.894406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.894220    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" event={"ID":"80676b23-b068-42e5-a539-1b8e3154d7a5","Type":"ContainerStarted","Data":"e6557d8922bdfe1cf423fc2aecf906ce9c3bb4e875e87e45bae0fc7a74735f84"}
Oct 30 14:20:26.938371 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:26.938307    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" podStartSLOduration=1.938290136 podStartE2EDuration="1.938290136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:26.937963765 +0000 UTC m=+820.572910410" watchObservedRunningTime="2026-10-30 14:20:26.938290136 +0000 UTC m=+820.573236770"
Oct 30 14:20:29.418701 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.418670    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"]
Oct 30 14:20:29.422551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.422531    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.457333 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.457306    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-137f01\""
Oct 30 14:20:29.462594 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.462555    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"]
Oct 30 14:20:29.492866 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.492824    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.493039 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.493018    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbt8t\" (UniqueName: \"kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t\") pod \"payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.514621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.514588    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"]
Oct 30 14:20:29.518265 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.518230    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.537429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.537400    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"]
Oct 30 14:20:29.538145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.538123    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-137f01-dockercfg-sz9fm\""
Oct 30 14:20:29.594176 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.594134    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qts7c\" (UniqueName: \"kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c\") pod \"payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.594349 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.594182    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.594430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.594358    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbt8t\" (UniqueName: \"kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t\") pod \"payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.594430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.594411    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.595206 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.595178    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.627501 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.627468    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbt8t\" (UniqueName: \"kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t\") pod \"payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.695833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.695729    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qts7c\" (UniqueName: \"kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c\") pod \"payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.695833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.695772    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.696723 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.696694    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.720619 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.720586    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qts7c\" (UniqueName: \"kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c\") pod \"payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:29.738305 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.738269    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:29.832750 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:29.832719    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:30.045026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.044939    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"]
Oct 30 14:20:30.049254 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:30.049209    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc334095f_eacd_42a2_ba0b_a6f819fd45f2.slice/crio-ae0801697a6037c5f2e2ee19dcbd30542f5da579804195fcd5e07eb57aa2158d WatchSource:0}: Error finding container ae0801697a6037c5f2e2ee19dcbd30542f5da579804195fcd5e07eb57aa2158d: Status 404 returned error can't find the container with id ae0801697a6037c5f2e2ee19dcbd30542f5da579804195fcd5e07eb57aa2158d
Oct 30 14:20:30.146410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.146377    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"]
Oct 30 14:20:30.149823 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:30.149797    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06de232b_9dbe_4144_abde_db72a2bddbf5.slice/crio-41c00cc6606bb188eb546601146dfd85073d78fc194c85cd91d23e668a3dfee9 WatchSource:0}: Error finding container 41c00cc6606bb188eb546601146dfd85073d78fc194c85cd91d23e668a3dfee9: Status 404 returned error can't find the container with id 41c00cc6606bb188eb546601146dfd85073d78fc194c85cd91d23e668a3dfee9
Oct 30 14:20:30.914556 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.914511    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" event={"ID":"06de232b-9dbe-4144-abde-db72a2bddbf5","Type":"ContainerStarted","Data":"7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1"}
Oct 30 14:20:30.915063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.914580    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" event={"ID":"06de232b-9dbe-4144-abde-db72a2bddbf5","Type":"ContainerStarted","Data":"41c00cc6606bb188eb546601146dfd85073d78fc194c85cd91d23e668a3dfee9"}
Oct 30 14:20:30.915063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.914659    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:30.916214 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.916190    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" event={"ID":"c334095f-eacd-42a2-ba0b-a6f819fd45f2","Type":"ContainerStarted","Data":"9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140"}
Oct 30 14:20:30.916344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.916227    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" event={"ID":"c334095f-eacd-42a2-ba0b-a6f819fd45f2","Type":"ContainerStarted","Data":"ae0801697a6037c5f2e2ee19dcbd30542f5da579804195fcd5e07eb57aa2158d"}
Oct 30 14:20:30.916344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.916288    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:30.961900 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:30.961839    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" podStartSLOduration=1.961825938 podStartE2EDuration="1.961825938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:30.960348581 +0000 UTC m=+824.595295200" watchObservedRunningTime="2026-10-30 14:20:30.961825938 +0000 UTC m=+824.596772558"
Oct 30 14:20:31.004218 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:31.004170    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" podStartSLOduration=2.004156427 podStartE2EDuration="2.004156427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:31.00249268 +0000 UTC m=+824.637439300" watchObservedRunningTime="2026-10-30 14:20:31.004156427 +0000 UTC m=+824.639103043"
Oct 30 14:20:31.620117 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:20:31.620069    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:20:35.097399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.097369    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"]
Oct 30 14:20:35.101175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.101155    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.122270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.122201    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"]
Oct 30 14:20:35.124735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.124703    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 14:20:35.132614 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.132587    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-137f01-serving-cert\""
Oct 30 14:20:35.132755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.132615    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bm7kg\""
Oct 30 14:20:35.132826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.132811    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 14:20:35.133520 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.133493    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 14:20:35.148128 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.148094    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9fq\" (UniqueName: \"kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.148304 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.148161    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.148304 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.148283    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.148457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.148332    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.249165 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.249129    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.249165 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.249164    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.249404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.249196    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.249404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.249316    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9fq\" (UniqueName: \"kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.249982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.249955    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.251698 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.251677    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.251795 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.251737    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.274049 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.274011    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9fq\" (UniqueName: \"kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq\") pod \"maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.415242 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.415155    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:35.719536 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.719450    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"]
Oct 30 14:20:35.723436 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:35.723405    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3d6438_3eaf_479e_b272_59d0e7704662.slice/crio-d899156976298703020cf224508e8e5a97fc1fcb0fae692e27059ad0b614d306 WatchSource:0}: Error finding container d899156976298703020cf224508e8e5a97fc1fcb0fae692e27059ad0b614d306: Status 404 returned error can't find the container with id d899156976298703020cf224508e8e5a97fc1fcb0fae692e27059ad0b614d306
Oct 30 14:20:35.942568 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:35.942532    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh" event={"ID":"ca3d6438-3eaf-479e-b272-59d0e7704662","Type":"ContainerStarted","Data":"d899156976298703020cf224508e8e5a97fc1fcb0fae692e27059ad0b614d306"}
Oct 30 14:20:36.898227 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:36.898198    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:20:36.898615 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:36.898299    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:20:36.898615 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:36.898452    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:20:37.902940 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:37.902905    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:20:38.963431 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:38.963396    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh" event={"ID":"ca3d6438-3eaf-479e-b272-59d0e7704662","Type":"ContainerStarted","Data":"32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b"}
Oct 30 14:20:38.964026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:38.963669    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:39.009314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:39.009230    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh" podStartSLOduration=1.644751722 podStartE2EDuration="4.009215474s" totalImagesPullingTime="2.364463752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:39.008383298 +0000 UTC m=+832.643329918" watchObservedRunningTime="2026-10-30 14:20:39.009215474 +0000 UTC m=+832.644162093"
Oct 30 14:20:41.923720 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:41.923684    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:20:41.924131 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:41.923763    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:20:44.975312 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:44.975280    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:20:47.587116 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.587080    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"]
Oct 30 14:20:47.591826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.591801    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.620724 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.620682    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-7bf15f\"/\"default-dockercfg-br9d6\""
Oct 30 14:20:47.620724 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.620685    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-7bf15f\"/\"simulator-w5-7bf15f-kserve-self-signed-certs\""
Oct 30 14:20:47.620921 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.620727    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-7bf15f\"/\"openshift-service-ca.crt\""
Oct 30 14:20:47.620969 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.620940    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-7bf15f\"/\"kube-root-ca.crt\""
Oct 30 14:20:47.622525 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.622504    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"]
Oct 30 14:20:47.677726 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.677689    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.677872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.677744    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk8lq\" (UniqueName: \"kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.677872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.677834    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.677963 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.677897    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.677963 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.677948    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.678034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.677974    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779149    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779199    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk8lq\" (UniqueName: \"kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779229    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779291    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779348    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779387    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779652    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779798 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779778    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.779857 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.779780    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.781634 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.781615    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.781719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.781703    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.803725 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.803693    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk8lq\" (UniqueName: \"kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq\") pod \"simulator-w5-7bf15f-kserve-7968b7d789-pzkdk\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") " pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:47.916491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:47.916414    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:48.220885 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:48.220804    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"]
Oct 30 14:20:48.224081 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:48.224047    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd98bcd5b_61d8_4e78_92f1_f08f63e76f2c.slice/crio-a97e799a3540562d54aa26a5bbbd24c3ee8f0fa682285c9fc9e04db2cb64ce26 WatchSource:0}: Error finding container a97e799a3540562d54aa26a5bbbd24c3ee8f0fa682285c9fc9e04db2cb64ce26: Status 404 returned error can't find the container with id a97e799a3540562d54aa26a5bbbd24c3ee8f0fa682285c9fc9e04db2cb64ce26
Oct 30 14:20:49.015307 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.015272    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" event={"ID":"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c","Type":"ContainerStarted","Data":"a97e799a3540562d54aa26a5bbbd24c3ee8f0fa682285c9fc9e04db2cb64ce26"}
Oct 30 14:20:49.751585 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.751552    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"]
Oct 30 14:20:49.755417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.755394    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:49.774516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.774485    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"]
Oct 30 14:20:49.784759 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.784734    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-bf8266\"/\"default-dockercfg-l8wgf\""
Oct 30 14:20:49.784924 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.784903    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-bf8266\"/\"openshift-service-ca.crt\""
Oct 30 14:20:49.784978 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.784937    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-bf8266\"/\"kube-root-ca.crt\""
Oct 30 14:20:49.872932 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.872890    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-bf8266\"/\"simulator-w6-bf8266-kserve-self-signed-certs\""
Oct 30 14:20:49.914291 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.914257    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:49.914498 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.914304    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:49.914498 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.914400    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:49.914498 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.914462    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:49.914601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.914522    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8pth\" (UniqueName: \"kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:49.914601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:49.914590    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016019    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016100    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016133    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016171    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016201    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016227    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8pth\" (UniqueName: \"kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016504    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016902 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016620    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.016902 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.016654    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.026031 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.026000    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.026241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.026216    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.030722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.030688    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" event={"ID":"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c","Type":"ContainerStarted","Data":"0a40bf7040af99f37350455f3d421379bf87302430ae3218a6aabea23074c50d"}
Oct 30 14:20:50.043309 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.043239    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8pth\" (UniqueName: \"kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth\") pod \"simulator-w6-bf8266-kserve-578fbb775-shgxh\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") " pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.073668 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.073636    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:50.076146 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.076092    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podStartSLOduration=1.733450968 podStartE2EDuration="3.07607885s" totalImagesPullingTime="1.342627882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:50.074031817 +0000 UTC m=+843.708978458" watchObservedRunningTime="2026-10-30 14:20:50.07607885 +0000 UTC m=+843.711025469"
Oct 30 14:20:50.376632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.376556    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"]
Oct 30 14:20:50.379934 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:20:50.379904    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda3c235b_eb75_489b_90fc_1c1d9475e207.slice/crio-5a356d3edc0e79a3db798f102b7ff665b47540b45dc4d9a65adffd078a714e2b WatchSource:0}: Error finding container 5a356d3edc0e79a3db798f102b7ff665b47540b45dc4d9a65adffd078a714e2b: Status 404 returned error can't find the container with id 5a356d3edc0e79a3db798f102b7ff665b47540b45dc4d9a65adffd078a714e2b
Oct 30 14:20:50.917434 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:50.917401    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:51.038469 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:51.038432    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" event={"ID":"da3c235b-eb75-489b-90fc-1c1d9475e207","Type":"ContainerStarted","Data":"101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593"}
Oct 30 14:20:51.038938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:51.038478    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" event={"ID":"da3c235b-eb75-489b-90fc-1c1d9475e207","Type":"ContainerStarted","Data":"5a356d3edc0e79a3db798f102b7ff665b47540b45dc4d9a65adffd078a714e2b"}
Oct 30 14:20:51.074414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:51.074383    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:20:51.083184 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:51.083127    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podStartSLOduration=2.083109569 podStartE2EDuration="2.083109569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:51.081349351 +0000 UTC m=+844.716295970" watchObservedRunningTime="2026-10-30 14:20:51.083109569 +0000 UTC m=+844.718056190"
Oct 30 14:20:57.917441 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:57.917405    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:57.930458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:57.930425    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:58.086332 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:58.086293    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:20:59.891382 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:59.891340    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"]
Oct 30 14:20:59.976080 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:59.976041    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"]
Oct 30 14:20:59.976280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:20:59.976145    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.005775 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.005740    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-a5ddf3\"/\"default-dockercfg-8cscx\""
Oct 30 14:21:00.006120 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.006099    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-a5ddf3\"/\"openshift-service-ca.crt\""
Oct 30 14:21:00.006215 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.006099    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-a5ddf3\"/\"simulator-w2-a5ddf3-kserve-self-signed-certs\""
Oct 30 14:21:00.006215 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.006112    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-a5ddf3\"/\"kube-root-ca.crt\""
Oct 30 14:21:00.017530 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.017499    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.017685 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.017542    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.017685 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.017582    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.017803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.017682    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.017803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.017735    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrt2\" (UniqueName: \"kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.017803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.017771    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.074563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.074512    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:21:00.089896 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.089864    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:21:00.101950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.101917    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:21:00.118296 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118261    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrt2\" (UniqueName: \"kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118315    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118351    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118393    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118457    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118507    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118806 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118780    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118937 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118856    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.118937 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.118855    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.120742 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.120724    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.120992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.120973    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.146159 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.146094    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrt2\" (UniqueName: \"kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2\") pod \"simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") " pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.301732 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.301699    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:00.633079 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:00.633048    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"]
Oct 30 14:21:00.636451 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:00.636424    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c4de9db_4347_460e_9f3c_bcdc9a1ec735.slice/crio-d637ed490c46931cd856d01579fdb2039b0017b84e488e6404f818d7bea0d9d7 WatchSource:0}: Error finding container d637ed490c46931cd856d01579fdb2039b0017b84e488e6404f818d7bea0d9d7: Status 404 returned error can't find the container with id d637ed490c46931cd856d01579fdb2039b0017b84e488e6404f818d7bea0d9d7
Oct 30 14:21:01.092212 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:01.092177    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" event={"ID":"0c4de9db-4347-460e-9f3c-bcdc9a1ec735","Type":"ContainerStarted","Data":"ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e"}
Oct 30 14:21:01.092712 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:01.092225    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" event={"ID":"0c4de9db-4347-460e-9f3c-bcdc9a1ec735","Type":"ContainerStarted","Data":"d637ed490c46931cd856d01579fdb2039b0017b84e488e6404f818d7bea0d9d7"}
Oct 30 14:21:01.136701 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:01.136657    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" podStartSLOduration=2.13664267 podStartE2EDuration="2.13664267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:01.135576575 +0000 UTC m=+854.770523198" watchObservedRunningTime="2026-10-30 14:21:01.13664267 +0000 UTC m=+854.771589289"
Oct 30 14:21:01.302162 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:01.302113    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:01.619528 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:21:01.619487    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:21:07.405859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.405818    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"]
Oct 30 14:21:07.410582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.410560    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.429087 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.429058    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"]
Oct 30 14:21:07.439324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.439300    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-717995\"/\"openshift-service-ca.crt\""
Oct 30 14:21:07.439478 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.439325    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-717995\"/\"kube-root-ca.crt\""
Oct 30 14:21:07.439478 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.439386    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-717995\"/\"simulator-w1-717995-kserve-self-signed-certs\""
Oct 30 14:21:07.439478 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.439456    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-717995\"/\"default-dockercfg-mvxrr\""
Oct 30 14:21:07.495511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.495471    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.495686 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.495640    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.495756 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.495687    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.495812 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.495776    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.495889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.495862    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.495933 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.495914    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkq8\" (UniqueName: \"kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.596897 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.596848    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.596908    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.596954    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.597029    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.597069    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkq8\" (UniqueName: \"kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597335 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.597100    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597392 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.597324    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597392 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.597345    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.597592 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.597562    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.599358 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.599336    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.599663 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.599638    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.621908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.621887    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkq8\" (UniqueName: \"kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8\") pod \"simulator-w1-717995-kserve-54885b485d-shmfx\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") " pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:07.725468 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:07.725378    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:08.027519 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:08.027444    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"]
Oct 30 14:21:08.030952 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:08.030921    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fdf05fa_4f78_4541_8eaf_d8f833fdba5b.slice/crio-7c02fdcb22f7210d191b770db231e810087a279eb8ecd7bdcd26c32f07ebc7bb WatchSource:0}: Error finding container 7c02fdcb22f7210d191b770db231e810087a279eb8ecd7bdcd26c32f07ebc7bb: Status 404 returned error can't find the container with id 7c02fdcb22f7210d191b770db231e810087a279eb8ecd7bdcd26c32f07ebc7bb
Oct 30 14:21:08.130214 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:08.130181    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" event={"ID":"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b","Type":"ContainerStarted","Data":"2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e"}
Oct 30 14:21:08.130399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:08.130223    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" event={"ID":"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b","Type":"ContainerStarted","Data":"7c02fdcb22f7210d191b770db231e810087a279eb8ecd7bdcd26c32f07ebc7bb"}
Oct 30 14:21:08.174949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:08.174898    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podStartSLOduration=1.174883145 podStartE2EDuration="1.174883145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:08.173276622 +0000 UTC m=+861.808223240" watchObservedRunningTime="2026-10-30 14:21:08.174883145 +0000 UTC m=+861.809829764"
Oct 30 14:21:08.725658 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:08.725623    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:10.302426 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:10.302393    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:10.315157 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:10.315132    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:11.157398 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:11.157358    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:21:13.851296 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.851263    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"]
Oct 30 14:21:13.855152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.855124    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:13.886670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.886642    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"default-dockercfg-nbjrd\""
Oct 30 14:21:13.886837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.886693    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"openshift-service-ca.crt\""
Oct 30 14:21:13.886837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.886716    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"kube-root-ca.crt\""
Oct 30 14:21:13.886837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.886714    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"simulator-w0-1d36cf-kserve-self-signed-certs\""
Oct 30 14:21:13.888621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.888602    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"]
Oct 30 14:21:13.959318 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.959275    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:13.959514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.959445    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:13.959514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.959500    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2jvz\" (UniqueName: \"kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:13.959695 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.959674    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:13.959730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.959708    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:13.959778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:13.959738    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060330    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060367    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060394    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060448    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060611 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060515    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060652    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2jvz\" (UniqueName: \"kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.060795 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.060767    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.061215 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.061188    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.061347 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.061300    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.062758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.062728    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.062949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.062933    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.087893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.087865    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2jvz\" (UniqueName: \"kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz\") pod \"simulator-w0-1d36cf-kserve-59d9b5df88-p649h\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") " pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.168764 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.168683    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:14.470130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:14.470054    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"]
Oct 30 14:21:14.473506 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:14.473476    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e08735_ec07_4a61_aef4_0703e558413f.slice/crio-5321a20db0cc249ac27529464e3b76d02408bf1e0edfddbcd16adf38e2c8f909 WatchSource:0}: Error finding container 5321a20db0cc249ac27529464e3b76d02408bf1e0edfddbcd16adf38e2c8f909: Status 404 returned error can't find the container with id 5321a20db0cc249ac27529464e3b76d02408bf1e0edfddbcd16adf38e2c8f909
Oct 30 14:21:15.168396 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:15.168363    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" event={"ID":"45e08735-ec07-4a61-aef4-0703e558413f","Type":"ContainerStarted","Data":"3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd"}
Oct 30 14:21:15.168794 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:15.168410    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" event={"ID":"45e08735-ec07-4a61-aef4-0703e558413f","Type":"ContainerStarted","Data":"5321a20db0cc249ac27529464e3b76d02408bf1e0edfddbcd16adf38e2c8f909"}
Oct 30 14:21:15.168911 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:15.168893    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:15.251175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:15.251125    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podStartSLOduration=2.251110259 podStartE2EDuration="2.251110259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:15.25046415 +0000 UTC m=+868.885410769" watchObservedRunningTime="2026-10-30 14:21:15.251110259 +0000 UTC m=+868.886056879"
Oct 30 14:21:17.726116 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:17.726076    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:17.738727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:17.738704    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:18.194123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:18.194096    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:21:24.169236 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:24.169197    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:24.182013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:24.181984    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:24.225538 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:24.225497    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:21:31.618892 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:21:31.618855    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:21:33.106926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.106887    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"]
Oct 30 14:21:33.124792 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.124767    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.131905 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.131880    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"]
Oct 30 14:21:33.141979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.141957    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-bf8266\"/\"premium-w6-bf8266-kserve-self-signed-certs\""
Oct 30 14:21:33.148750 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.148726    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzglk\" (UniqueName: \"kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.148888 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.148833    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.148888 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.148852    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.148888 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.148877    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.149050 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.149017    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.149102 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.149072    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250418 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250385    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250437    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250455    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzglk\" (UniqueName: \"kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250514    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250530    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250546    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.250904 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250871    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.251017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.250944    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.251150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.251127    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.252749 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.252727    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.253480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.253463    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.275539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.275508    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzglk\" (UniqueName: \"kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk\") pod \"premium-w6-bf8266-kserve-7975c45658-q7fzn\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") " pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.438643 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.438566    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:33.738947 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:33.738849    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"]
Oct 30 14:21:33.742948 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:33.742909    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd37a3272_56f2_42c3_8b86_d81af0762ebc.slice/crio-8601e6991e56b840409db989d2881b2e0491852bc755a91e845d317a2a292438 WatchSource:0}: Error finding container 8601e6991e56b840409db989d2881b2e0491852bc755a91e845d317a2a292438: Status 404 returned error can't find the container with id 8601e6991e56b840409db989d2881b2e0491852bc755a91e845d317a2a292438
Oct 30 14:21:34.276927 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:34.276874    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" event={"ID":"d37a3272-56f2-42c3-8b86-d81af0762ebc","Type":"ContainerStarted","Data":"af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930"}
Oct 30 14:21:34.277397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:34.276937    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" event={"ID":"d37a3272-56f2-42c3-8b86-d81af0762ebc","Type":"ContainerStarted","Data":"8601e6991e56b840409db989d2881b2e0491852bc755a91e845d317a2a292438"}
Oct 30 14:21:34.326413 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:34.326367    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" podStartSLOduration=1.326352584 podStartE2EDuration="1.326352584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:34.324971216 +0000 UTC m=+887.959917835" watchObservedRunningTime="2026-10-30 14:21:34.326352584 +0000 UTC m=+887.961299203"
Oct 30 14:21:34.439327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:34.439296    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:43.439334 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:43.439296    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:43.451491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:43.451463    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:44.338391 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:44.338359    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:21:45.661890 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.661846    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"]
Oct 30 14:21:45.666876 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.666848    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.683214 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.683193    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-24dfd7\"/\"kube-root-ca.crt\""
Oct 30 14:21:45.698579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.698550    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-24dfd7\"/\"default-dockercfg-ggr84\""
Oct 30 14:21:45.698717 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.698591    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-24dfd7\"/\"premium-w3-24dfd7-kserve-self-signed-certs\""
Oct 30 14:21:45.699437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.699417    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"]
Oct 30 14:21:45.768659 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.768620    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.768836 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.768667    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.768836 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.768757    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.768967 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.768901    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47f4r\" (UniqueName: \"kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.768967 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.768947    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.769096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.769080    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.785262 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.785224    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-24dfd7\"/\"openshift-service-ca.crt\""
Oct 30 14:21:45.869997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.869962    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.870203 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.870062    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.870203 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.870094    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.870348 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.870223    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47f4r\" (UniqueName: \"kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.870348 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.870275    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.870455 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.870359    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.871096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.871071    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.871204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.871116    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.871329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.871309    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.873234 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.873208    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.873356 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.873330    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.898404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.898370    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47f4r\" (UniqueName: \"kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r\") pod \"premium-w3-24dfd7-kserve-75c8ffdb44-5qstg\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") " pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:45.979429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:45.979323    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:46.279532 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:46.279448    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"]
Oct 30 14:21:46.283762 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:46.283732    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81ec0b99_917e_43c4_a034_2332e47bf029.slice/crio-41c45f89ce8a52dedc6438f2d194f1730f8878217a7dc870c2eddb937304dfb8 WatchSource:0}: Error finding container 41c45f89ce8a52dedc6438f2d194f1730f8878217a7dc870c2eddb937304dfb8: Status 404 returned error can't find the container with id 41c45f89ce8a52dedc6438f2d194f1730f8878217a7dc870c2eddb937304dfb8
Oct 30 14:21:46.341929 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:46.341899    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" event={"ID":"81ec0b99-917e-43c4-a034-2332e47bf029","Type":"ContainerStarted","Data":"41c45f89ce8a52dedc6438f2d194f1730f8878217a7dc870c2eddb937304dfb8"}
Oct 30 14:21:47.352038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:47.351983    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" event={"ID":"81ec0b99-917e-43c4-a034-2332e47bf029","Type":"ContainerStarted","Data":"db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235"}
Oct 30 14:21:47.398924 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:47.398865    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podStartSLOduration=2.398849602 podStartE2EDuration="2.398849602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:47.396614239 +0000 UTC m=+901.031560863" watchObservedRunningTime="2026-10-30 14:21:47.398849602 +0000 UTC m=+901.033796223"
Oct 30 14:21:47.980105 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:47.980070    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:50.336504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.336469    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"]
Oct 30 14:21:50.341605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.341581    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.368529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.368493    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"]
Oct 30 14:21:50.377639 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.377616    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-717995\"/\"premium-w1-717995-kserve-self-signed-certs\""
Oct 30 14:21:50.416596 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.416558    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.416863 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.416607    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.416863 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.416752    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.416992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.416909    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.416992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.416956    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.417105 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.416985    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6wz\" (UniqueName: \"kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.518625 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.518590    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.518832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.518638    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.518832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.518696    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.518832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.518750    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.519560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.519110    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.519560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.519146    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.519560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.519143    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.519560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.519182    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.519560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.519215    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6wz\" (UniqueName: \"kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.521126 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.521103    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.521701 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.521683    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.545304 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.544978    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6wz\" (UniqueName: \"kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz\") pod \"premium-w1-717995-kserve-84d77b64c-x2z9x\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") " pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.654879 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.654793    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:50.958073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:50.957992    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"]
Oct 30 14:21:50.961835 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:50.961805    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1195db10_b66c_4897_979d_2e22f52e6eec.slice/crio-32857e7a343211c68f3d99679a93d35dd806af408de21126a0e0413a7cee319c WatchSource:0}: Error finding container 32857e7a343211c68f3d99679a93d35dd806af408de21126a0e0413a7cee319c: Status 404 returned error can't find the container with id 32857e7a343211c68f3d99679a93d35dd806af408de21126a0e0413a7cee319c
Oct 30 14:21:51.377099 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:51.377056    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" event={"ID":"1195db10-b66c-4897-979d-2e22f52e6eec","Type":"ContainerStarted","Data":"66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6"}
Oct 30 14:21:51.377606 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:51.377108    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" event={"ID":"1195db10-b66c-4897-979d-2e22f52e6eec","Type":"ContainerStarted","Data":"32857e7a343211c68f3d99679a93d35dd806af408de21126a0e0413a7cee319c"}
Oct 30 14:21:51.420979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:51.420924    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podStartSLOduration=1.420909467 podStartE2EDuration="1.420909467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:51.420059758 +0000 UTC m=+905.055006382" watchObservedRunningTime="2026-10-30 14:21:51.420909467 +0000 UTC m=+905.055856123"
Oct 30 14:21:51.655241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:51.655144    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:21:55.979766 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:55.979726    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:55.992480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:55.992449    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:56.416013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:56.415983    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:21:57.609350 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.609320    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"]
Oct 30 14:21:57.613507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.613483    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.638017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.637989    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"]
Oct 30 14:21:57.642024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.641997    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"premium-w0-1d36cf-kserve-self-signed-certs\""
Oct 30 14:21:57.696318 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.696289    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.696318 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.696323    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.696559 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.696344    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4dlb\" (UniqueName: \"kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.696559 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.696531    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.696663 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.696637    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.696724 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.696709    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.797704 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.797657    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.797903 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.797763    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.797903 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.797814    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.797903 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.797845    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.797903 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.797874    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4dlb\" (UniqueName: \"kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.798109 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.797930    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.798479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.798448    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.798629 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.798461    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.798629 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.798513    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.800649 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.800623    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.801157 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.801131    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.845974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.845884    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4dlb\" (UniqueName: \"kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb\") pod \"premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") " pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:57.928180 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:57.928094    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:21:58.228193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:58.228113    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"]
Oct 30 14:21:58.232806 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:21:58.232757    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fd5733f_0623_4401_b880_46957dca3a4a.slice/crio-21c50d57909a4046cb02d1f5e0a7cded6a54deb228d1641510c90a2e6df328fa WatchSource:0}: Error finding container 21c50d57909a4046cb02d1f5e0a7cded6a54deb228d1641510c90a2e6df328fa: Status 404 returned error can't find the container with id 21c50d57909a4046cb02d1f5e0a7cded6a54deb228d1641510c90a2e6df328fa
Oct 30 14:21:58.419043 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:58.419004    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" event={"ID":"8fd5733f-0623-4401-b880-46957dca3a4a","Type":"ContainerStarted","Data":"2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15"}
Oct 30 14:21:58.419211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:58.419053    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" event={"ID":"8fd5733f-0623-4401-b880-46957dca3a4a","Type":"ContainerStarted","Data":"21c50d57909a4046cb02d1f5e0a7cded6a54deb228d1641510c90a2e6df328fa"}
Oct 30 14:21:58.466084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:58.466033    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podStartSLOduration=1.4660188060000001 podStartE2EDuration="1.466018806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:58.4635876 +0000 UTC m=+912.098534232" watchObservedRunningTime="2026-10-30 14:21:58.466018806 +0000 UTC m=+912.100965443"
Oct 30 14:21:58.928718 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:21:58.928674    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:22:00.655055 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:00.655016    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:22:00.667890 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:00.667868    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:22:01.446050 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:01.446017    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:22:01.623311 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:22:01.623240    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:22:07.928318 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:07.928285    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:22:07.940936 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:07.940909    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:22:08.482761 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:08.482732    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:22:31.332514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.332432    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"]
Oct 30 14:22:31.338835 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.338811    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.363831 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.363803    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"]
Oct 30 14:22:31.373170 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.373138    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-24dfd7-openshift-default-dockercfg-r2zgj\""
Oct 30 14:22:31.456964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.456927    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457122 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.456969    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457122 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457079    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457276 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457126    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7sr\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457276 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457218    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457281    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457448 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457428    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457483 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457461    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.457528 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.457487    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558516    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558556    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558591    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558648    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558682    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558721    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.558777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558748    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7sr\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559015 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.558778    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.559015    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559128 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.559068    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.559226    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559353 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.559339    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559503 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.559486    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.559556 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.559524    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.560947 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.560920    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.561184 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.561165    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.583937 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.583885    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.584109 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.584081    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7sr\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.618065 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:22:31.618035    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:22:31.652491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.652469    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:31.974784 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.974705    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"]
Oct 30 14:22:31.977813 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:22:31.977786    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63089898_49c0_4f68_a2e1_6b68425e1f76.slice/crio-17da115b30a831fce7f06dbbac703a3ec38d78e60eb56af324adb28854658eeb WatchSource:0}: Error finding container 17da115b30a831fce7f06dbbac703a3ec38d78e60eb56af324adb28854658eeb: Status 404 returned error can't find the container with id 17da115b30a831fce7f06dbbac703a3ec38d78e60eb56af324adb28854658eeb
Oct 30 14:22:31.979987 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.979954    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:22:31.980071 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.980022    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:22:31.980071 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:31.980050    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:22:32.596473 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:32.596439    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" event={"ID":"63089898-49c0-4f68-a2e1-6b68425e1f76","Type":"ContainerStarted","Data":"3495c4c8c736dc8c35c5cc3245a05757880d126226d086d14ac2b044986dbc61"}
Oct 30 14:22:32.596856 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:32.596488    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" event={"ID":"63089898-49c0-4f68-a2e1-6b68425e1f76","Type":"ContainerStarted","Data":"17da115b30a831fce7f06dbbac703a3ec38d78e60eb56af324adb28854658eeb"}
Oct 30 14:22:32.653576 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:32.653529    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:32.661081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:32.661035    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podStartSLOduration=1.661016995 podStartE2EDuration="1.661016995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:22:32.65806103 +0000 UTC m=+946.293007647" watchObservedRunningTime="2026-10-30 14:22:32.661016995 +0000 UTC m=+946.295963619"
Oct 30 14:22:33.655126 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:33.655090    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 14:22:33.655548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:33.655138    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 14:22:34.653702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:34.653668    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 14:22:34.653918 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:34.653741    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 14:22:35.653770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:35.653738    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 14:22:35.654173 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:35.653801    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 14:22:36.652879 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:36.652839    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 14:22:36.653052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:36.652917    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 14:22:37.653746 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:37.653710    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Oct 30 14:22:37.654095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:37.653765    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Oct 30 14:22:38.548793 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.548758    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"]
Oct 30 14:22:38.552914 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.552896    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.572775 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.572747    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"]
Oct 30 14:22:38.581594 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.581567    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:22:38.581737 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.581632    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:22:38.660179 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.660137    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.660669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.660190    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz99p\" (UniqueName: \"kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.660669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.660466    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.761700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.761664    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.761990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.761746    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.761990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.761781    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz99p\" (UniqueName: \"kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.762663 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.762638    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.764212 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.764186    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.786585 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.786560    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz99p\" (UniqueName: \"kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p\") pod \"maas-api-revoke-sub-d95816b3-885pz\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:38.862465 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.862440    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:38.863267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.863227    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:38.863953 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.863935    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:22:38.866089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:38.866071    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:39.173127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:39.173026    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"]
Oct 30 14:22:39.178897 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:22:39.178861    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728f626e_7c29_45e5_9b65_462bfd1773f9.slice/crio-a9ae991b7b9befd13074e0f29e21494400a5b4a2a720ceda8254d8f10dfd3963 WatchSource:0}: Error finding container a9ae991b7b9befd13074e0f29e21494400a5b4a2a720ceda8254d8f10dfd3963: Status 404 returned error can't find the container with id a9ae991b7b9befd13074e0f29e21494400a5b4a2a720ceda8254d8f10dfd3963
Oct 30 14:22:39.180884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:39.180864    4538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 14:22:39.633879 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:39.633846    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz" event={"ID":"728f626e-7c29-45e5-9b65-462bfd1773f9","Type":"ContainerStarted","Data":"a9ae991b7b9befd13074e0f29e21494400a5b4a2a720ceda8254d8f10dfd3963"}
Oct 30 14:22:41.646505 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:41.646470    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz" event={"ID":"728f626e-7c29-45e5-9b65-462bfd1773f9","Type":"ContainerStarted","Data":"67c6b5af23aed9531a17853a883df2ba1dc9eb59c08ae4ad44ac58c72c3c43f9"}
Oct 30 14:22:41.690449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:41.690388    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz" podStartSLOduration=1.6757737609999999 podStartE2EDuration="3.690370187s" totalImagesPullingTime="2.014596426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:22:41.688654274 +0000 UTC m=+955.323600895" watchObservedRunningTime="2026-10-30 14:22:41.690370187 +0000 UTC m=+955.325316808"
Oct 30 14:22:42.657140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:42.657103    4538 generic.go:356] "Generic (PLEG): container finished" podID="728f626e-7c29-45e5-9b65-462bfd1773f9" containerID="67c6b5af23aed9531a17853a883df2ba1dc9eb59c08ae4ad44ac58c72c3c43f9" exitCode=0
Oct 30 14:22:42.657553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:42.657197    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz" event={"ID":"728f626e-7c29-45e5-9b65-462bfd1773f9","Type":"ContainerDied","Data":"67c6b5af23aed9531a17853a883df2ba1dc9eb59c08ae4ad44ac58c72c3c43f9"}
Oct 30 14:22:43.914104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:43.914074    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:44.012889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.012797    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p\" (UniqueName: \"kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p\") pod \"728f626e-7c29-45e5-9b65-462bfd1773f9\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") "
Oct 30 14:22:44.012889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.012848    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca\") pod \"728f626e-7c29-45e5-9b65-462bfd1773f9\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") "
Oct 30 14:22:44.012889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.012878    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca\") pod \"728f626e-7c29-45e5-9b65-462bfd1773f9\" (UID: \"728f626e-7c29-45e5-9b65-462bfd1773f9\") "
Oct 30 14:22:44.013511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.013238    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca" pod "728f626e-7c29-45e5-9b65-462bfd1773f9" (UID: "728f626e-7c29-45e5-9b65-462bfd1773f9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:22:44.013511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.013452    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:22:44.015411 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.015379    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p" pod "728f626e-7c29-45e5-9b65-462bfd1773f9" (UID: "728f626e-7c29-45e5-9b65-462bfd1773f9"). InnerVolumeSpecName "kube-api-access-qz99p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:22:44.016353 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.016331    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca" pod "728f626e-7c29-45e5-9b65-462bfd1773f9" (UID: "728f626e-7c29-45e5-9b65-462bfd1773f9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:22:44.114364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.114325    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz99p\" (UniqueName: \"kubernetes.io/projected/728f626e-7c29-45e5-9b65-462bfd1773f9-kube-api-access-qz99p\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:22:44.114364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.114354    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/728f626e-7c29-45e5-9b65-462bfd1773f9-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:22:44.675834 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.675804    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"
Oct 30 14:22:44.676019 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.675838    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz" event={"ID":"728f626e-7c29-45e5-9b65-462bfd1773f9","Type":"ContainerDied","Data":"a9ae991b7b9befd13074e0f29e21494400a5b4a2a720ceda8254d8f10dfd3963"}
Oct 30 14:22:44.676019 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:44.675900    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9ae991b7b9befd13074e0f29e21494400a5b4a2a720ceda8254d8f10dfd3963"
Oct 30 14:22:46.101269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.100222    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"]
Oct 30 14:22:46.101269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.101050    4538 cpu_manager.go:414] "containerMap: removing container" podUID="728f626e-7c29-45e5-9b65-462bfd1773f9" containerName="revoke-keys"
Oct 30 14:22:46.101269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.101070    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="728f626e-7c29-45e5-9b65-462bfd1773f9" containerName="revoke-keys"
Oct 30 14:22:46.101269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.101221    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="728f626e-7c29-45e5-9b65-462bfd1773f9" containerName="revoke-keys"
Oct 30 14:22:46.105317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.105280    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.113090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.112967    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"]
Oct 30 14:22:46.122437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.122405    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-7bf15f-openshift-default-dockercfg-d4kcn\""
Oct 30 14:22:46.197854 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.197812    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.206352 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.206320    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.206610 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.206590    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.206768 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.206751    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.206893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.206874    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.211269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.206994    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp69g\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.211518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.211496    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.212482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.211699    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.212482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.211862    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.312953 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.312919    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.312953 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.312960    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.312982    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313023    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313052    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313068    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313083    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp69g\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313101    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313127    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.313988 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.313960    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.314222 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.314194    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.314339 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.314313    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.314400 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.314357    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.314480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.314453    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.315996 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.315974    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.316079 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.316029    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.360974 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.360906    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.370988 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.370931    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp69g\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.431268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.427412    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:46.814336 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.814267    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"]
Oct 30 14:22:46.817405 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:22:46.817381    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af36ee1_3a0d_4165_a048_0b4be7219f4f.slice/crio-965fb075b6268e9a9f776e28c23ab8739d257ac72c14eb15b50f4fa80666dc88 WatchSource:0}: Error finding container 965fb075b6268e9a9f776e28c23ab8739d257ac72c14eb15b50f4fa80666dc88: Status 404 returned error can't find the container with id 965fb075b6268e9a9f776e28c23ab8739d257ac72c14eb15b50f4fa80666dc88
Oct 30 14:22:46.819694 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.819662    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:22:46.819774 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.819723    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:22:46.819774 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:46.819752    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:22:47.721095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:47.721063    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" event={"ID":"8af36ee1-3a0d-4165-a048-0b4be7219f4f","Type":"ContainerStarted","Data":"f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262"}
Oct 30 14:22:47.721499 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:47.721122    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" event={"ID":"8af36ee1-3a0d-4165-a048-0b4be7219f4f","Type":"ContainerStarted","Data":"965fb075b6268e9a9f776e28c23ab8739d257ac72c14eb15b50f4fa80666dc88"}
Oct 30 14:22:47.782305 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:47.782234    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podStartSLOduration=1.782216201 podStartE2EDuration="1.782216201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:22:47.781065492 +0000 UTC m=+961.416012109" watchObservedRunningTime="2026-10-30 14:22:47.782216201 +0000 UTC m=+961.417162823"
Oct 30 14:22:48.446958 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:48.445888    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:48.449382 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:48.449349    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 14:22:48.449510 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:48.449422    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 14:22:49.433595 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:49.433561    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 14:22:49.434320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:49.434278    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 14:22:50.448272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:50.446371    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 14:22:50.448272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:50.446437    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 14:22:51.121679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.121645    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"]
Oct 30 14:22:51.140270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.137743    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.154397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.154368    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"]
Oct 30 14:22:51.156617 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.156584    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:22:51.156767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.156632    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:22:51.185907 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.185878    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.185907 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.185910    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9sp\" (UniqueName: \"kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.186135 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.186087    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.287164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.287126    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.287376 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.287185    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.287376 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.287212    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9sp\" (UniqueName: \"kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.287824 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.287799    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.289537 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.289513    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.313329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.313301    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9sp\" (UniqueName: \"kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp\") pod \"maas-api-revoke-sub-caa57078-wsjwl\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.444883 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.444795    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 14:22:51.445585 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.445553    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 14:22:51.466230 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.466207    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:51.767135 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:51.767062    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"]
Oct 30 14:22:51.770889 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:22:51.770862    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cde5516_21a8_4856_b29e_cee356d8f358.slice/crio-11783d21f1e8c62b26185bc4f6b354f5279c082e1d4a1f6dfd157fcd82135684 WatchSource:0}: Error finding container 11783d21f1e8c62b26185bc4f6b354f5279c082e1d4a1f6dfd157fcd82135684: Status 404 returned error can't find the container with id 11783d21f1e8c62b26185bc4f6b354f5279c082e1d4a1f6dfd157fcd82135684
Oct 30 14:22:52.442658 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:52.442569    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Oct 30 14:22:52.442910 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:52.442873    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Oct 30 14:22:52.769880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:52.769838    4538 generic.go:356] "Generic (PLEG): container finished" podID="7cde5516-21a8-4856-b29e-cee356d8f358" containerID="bcd22247ae621a2d7aa25f3cd8ec9d5a19ae738a50775349c023ea57425d5593" exitCode=0
Oct 30 14:22:52.770224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:52.769979    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl" event={"ID":"7cde5516-21a8-4856-b29e-cee356d8f358","Type":"ContainerDied","Data":"bcd22247ae621a2d7aa25f3cd8ec9d5a19ae738a50775349c023ea57425d5593"}
Oct 30 14:22:52.770224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:52.770034    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl" event={"ID":"7cde5516-21a8-4856-b29e-cee356d8f358","Type":"ContainerStarted","Data":"11783d21f1e8c62b26185bc4f6b354f5279c082e1d4a1f6dfd157fcd82135684"}
Oct 30 14:22:53.526998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:53.526941    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:53.527526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:53.527460    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:53.528502 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:53.528460    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:22:53.923060 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:53.923034    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:54.018139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.018103    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp\" (UniqueName: \"kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp\") pod \"7cde5516-21a8-4856-b29e-cee356d8f358\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") "
Oct 30 14:22:54.018316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.018296    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca\") pod \"7cde5516-21a8-4856-b29e-cee356d8f358\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") "
Oct 30 14:22:54.018368 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.018328    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca\") pod \"7cde5516-21a8-4856-b29e-cee356d8f358\" (UID: \"7cde5516-21a8-4856-b29e-cee356d8f358\") "
Oct 30 14:22:54.018643 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.018615    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca" pod "7cde5516-21a8-4856-b29e-cee356d8f358" (UID: "7cde5516-21a8-4856-b29e-cee356d8f358"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:22:54.020181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.020154    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp" pod "7cde5516-21a8-4856-b29e-cee356d8f358" (UID: "7cde5516-21a8-4856-b29e-cee356d8f358"). InnerVolumeSpecName "kube-api-access-mv9sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:22:54.020440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.020421    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca" pod "7cde5516-21a8-4856-b29e-cee356d8f358" (UID: "7cde5516-21a8-4856-b29e-cee356d8f358"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:22:54.119439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.119410    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9sp\" (UniqueName: \"kubernetes.io/projected/7cde5516-21a8-4856-b29e-cee356d8f358-kube-api-access-mv9sp\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:22:54.119439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.119436    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:22:54.119439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.119446    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cde5516-21a8-4856-b29e-cee356d8f358-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:22:54.782387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.781815    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"
Oct 30 14:22:54.782387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.781850    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl" event={"ID":"7cde5516-21a8-4856-b29e-cee356d8f358","Type":"ContainerDied","Data":"11783d21f1e8c62b26185bc4f6b354f5279c082e1d4a1f6dfd157fcd82135684"}
Oct 30 14:22:54.782387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:22:54.781899    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11783d21f1e8c62b26185bc4f6b354f5279c082e1d4a1f6dfd157fcd82135684"
Oct 30 14:23:00.817275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.817214    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"]
Oct 30 14:23:00.817718 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.817702    4538 cpu_manager.go:414] "containerMap: removing container" podUID="7cde5516-21a8-4856-b29e-cee356d8f358" containerName="revoke-keys"
Oct 30 14:23:00.817762 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.817719    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cde5516-21a8-4856-b29e-cee356d8f358" containerName="revoke-keys"
Oct 30 14:23:00.817833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.817824    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cde5516-21a8-4856-b29e-cee356d8f358" containerName="revoke-keys"
Oct 30 14:23:00.821264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.821232    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:00.837653 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.837622    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-a5ddf3-openshift-default-dockercfg-7z79k\""
Oct 30 14:23:00.883360 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:00.883334    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"]
Oct 30 14:23:01.005435 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005388    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.005635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005440    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.005635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005554    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8t8q\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.005635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005617    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.005834 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005691    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.005834 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005733    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.005834 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005803    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.006008 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005917    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.006008 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.005976    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107405 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107281    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107405 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107363    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107418    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107469    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107538    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107600    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107665    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107696    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.107950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.107735    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8t8q\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.110040 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.110008    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.110761 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.110304    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.111039 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.111012    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.111306 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.111283    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.111636 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.111616    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.119464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.119402    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.119736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.119711    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.137216 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.137166    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8t8q\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.138065 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.138014    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.140063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.139850    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:01.512137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.512111    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"]
Oct 30 14:23:01.514643 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:23:01.514613    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7ef1b4_54e9_4a73_a912_62e6f5886c88.slice/crio-74d60694d43dc20960108a20d9421feacf7165cdd74a076971945b99407d2fd5 WatchSource:0}: Error finding container 74d60694d43dc20960108a20d9421feacf7165cdd74a076971945b99407d2fd5: Status 404 returned error can't find the container with id 74d60694d43dc20960108a20d9421feacf7165cdd74a076971945b99407d2fd5
Oct 30 14:23:01.517395 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.517362    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:01.517463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.517428    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:01.517463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.517458    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:01.621151 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:23:01.621115    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:23:01.822574 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.822480    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" event={"ID":"de7ef1b4-54e9-4a73-a912-62e6f5886c88","Type":"ContainerStarted","Data":"a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc"}
Oct 30 14:23:01.822574 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.822560    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" event={"ID":"de7ef1b4-54e9-4a73-a912-62e6f5886c88","Type":"ContainerStarted","Data":"74d60694d43dc20960108a20d9421feacf7165cdd74a076971945b99407d2fd5"}
Oct 30 14:23:01.874632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:01.874573    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podStartSLOduration=1.8745587430000001 podStartE2EDuration="1.874558743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:01.87323703 +0000 UTC m=+975.508183699" watchObservedRunningTime="2026-10-30 14:23:01.874558743 +0000 UTC m=+975.509505362"
Oct 30 14:23:02.140518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:02.140472    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:02.142426 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:02.142401    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:02.142595 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:02.142458    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:03.140693 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:03.140652    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:03.144495 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:03.141238    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:04.140693 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:04.140653    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:04.140979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:04.140951    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:05.141269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:05.140585    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:05.141269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:05.140647    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:06.145213 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:06.145178    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:06.145826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:06.145795    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:07.140655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:07.140613    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:07.140950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:07.140919    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:08.141364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:08.141325    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Oct 30 14:23:08.141785 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:08.141395    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Oct 30 14:23:09.145112 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:09.145081    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:09.145508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:09.145454    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:09.146081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:09.146056    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:23:15.988038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:15.988000    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"]
Oct 30 14:23:15.996666 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:15.996643    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.015703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.015675    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"]
Oct 30 14:23:16.024835 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.024811    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-bf8266-openshift-default-dockercfg-9c8kq\""
Oct 30 14:23:16.094511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094474    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094539    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n6tz\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094627    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094664    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094800 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094727    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094800 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094754    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094879 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094827    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094904    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.094955 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.094928    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.195638 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195603    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.195802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195675    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.195802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195696    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.195802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195755    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.195802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195789    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6tz\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195839    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195877    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195907    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.195929    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196257 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.196223    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196389 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.196367    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.196396    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.196396    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.196464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.196430    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.198301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.198274    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.198423 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.198371    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.220375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.220350    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.220755 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.220734    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6tz\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.310298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.310228    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:16.632973 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.632940    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"]
Oct 30 14:23:16.638357 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:23:16.638332    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad329dfc_08aa_4c5e_acbb_21fa74563261.slice/crio-804974a44a50d350865625a1245c944a64299fe17d0a939f9a6c9c28315a98f5 WatchSource:0}: Error finding container 804974a44a50d350865625a1245c944a64299fe17d0a939f9a6c9c28315a98f5: Status 404 returned error can't find the container with id 804974a44a50d350865625a1245c944a64299fe17d0a939f9a6c9c28315a98f5
Oct 30 14:23:16.640508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.640474    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:16.640591 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.640544    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:16.640591 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.640576    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:16.913763 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.913672    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" event={"ID":"ad329dfc-08aa-4c5e-acbb-21fa74563261","Type":"ContainerStarted","Data":"dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560"}
Oct 30 14:23:16.913763 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.913727    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" event={"ID":"ad329dfc-08aa-4c5e-acbb-21fa74563261","Type":"ContainerStarted","Data":"804974a44a50d350865625a1245c944a64299fe17d0a939f9a6c9c28315a98f5"}
Oct 30 14:23:16.961569 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:16.961521    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podStartSLOduration=1.961507021 podStartE2EDuration="1.961507021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:16.960365186 +0000 UTC m=+990.595311805" watchObservedRunningTime="2026-10-30 14:23:16.961507021 +0000 UTC m=+990.596453692"
Oct 30 14:23:17.311077 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:17.310992    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:17.312574 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:17.312546    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 14:23:17.312716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:17.312618    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 14:23:18.311067 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:18.311037    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 14:23:18.311236 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:18.311087    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 14:23:19.310891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:19.310853    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 14:23:19.311070 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:19.310915    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 14:23:20.311301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:20.311268    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 14:23:20.311757 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:20.311325    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 14:23:21.311073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:21.311043    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 14:23:21.311255 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:21.311092    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 14:23:22.311640 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:22.311608    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Oct 30 14:23:22.312026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:22.311666    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Oct 30 14:23:23.651002 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:23.650969    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:23.651420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:23.651360    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:23.652077 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:23.652050    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:23:30.639811 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.639768    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"]
Oct 30 14:23:30.645710 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.645682    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.662904 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.662874    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"]
Oct 30 14:23:30.670825 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.670797    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"distinct-w0-1d36cf-kserve-self-signed-certs\""
Oct 30 14:23:30.686507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.686475    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.686613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.686541    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.686665 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.686644    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.686702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.686673    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.686803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.686785    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pfs\" (UniqueName: \"kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.686862 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.686815    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788093    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pfs\" (UniqueName: \"kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788136    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788202    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788242    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788324    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788347    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788686    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788703    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.788872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.788845    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.791241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.791210    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.791479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.791440    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.813306 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.813276    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pfs\" (UniqueName: \"kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs\") pod \"distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:30.963733 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:30.963624    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:31.270648 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.270620    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"]
Oct 30 14:23:31.273009 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:23:31.272978    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20f273f4_027a_43a0_9347_f065adbec5de.slice/crio-421427e6044ec194b31cf8aff1d184d01e7158d425688f92e09738ee157cd676 WatchSource:0}: Error finding container 421427e6044ec194b31cf8aff1d184d01e7158d425688f92e09738ee157cd676: Status 404 returned error can't find the container with id 421427e6044ec194b31cf8aff1d184d01e7158d425688f92e09738ee157cd676
Oct 30 14:23:31.400363 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.400329    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"]
Oct 30 14:23:31.404455 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.404432    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.425149 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.425109    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"]
Oct 30 14:23:31.441264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.435486    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-137f01-openshift-default-dockercfg-wmd9z\""
Oct 30 14:23:31.498344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498302    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498503 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498366    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498546 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498496    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498557    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498615 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498589    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6tp\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498648 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498635    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498709 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498692    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498745 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498729    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.498778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.498763    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600074 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600039    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600436 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600405    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600515    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600617 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600574    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600617 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600602    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6tp\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600721 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600655    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600748    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600779    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600792    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.600833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600817    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.601029 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.600937    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.601085 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.601053    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.601474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.601450    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.602145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.602116    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.603446 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.603414    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.606074 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.606048    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.622190 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:23:31.622165    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:23:31.628086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.628059    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.629466 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.629439    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6tp\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:31.721650 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:31.721611    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:32.019166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.019086    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" event={"ID":"20f273f4-027a-43a0-9347-f065adbec5de","Type":"ContainerStarted","Data":"1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438"}
Oct 30 14:23:32.019166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.019127    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" event={"ID":"20f273f4-027a-43a0-9347-f065adbec5de","Type":"ContainerStarted","Data":"421427e6044ec194b31cf8aff1d184d01e7158d425688f92e09738ee157cd676"}
Oct 30 14:23:32.057437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.057397    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"]
Oct 30 14:23:32.061380 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:23:32.061349    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff8fbdb_84f8_4c46_9f34_ff508b8b008f.slice/crio-ed176fe6b06bc4c52d44eddf4e739f2dd6393f328ce60e4a44944d985af3553a WatchSource:0}: Error finding container ed176fe6b06bc4c52d44eddf4e739f2dd6393f328ce60e4a44944d985af3553a: Status 404 returned error can't find the container with id ed176fe6b06bc4c52d44eddf4e739f2dd6393f328ce60e4a44944d985af3553a
Oct 30 14:23:32.064088 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.064031    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:32.064287 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.064115    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:32.064287 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.064161    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:23:32.069202 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.068960    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podStartSLOduration=2.068942224 podStartE2EDuration="2.068942224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:32.065408387 +0000 UTC m=+1005.700355035" watchObservedRunningTime="2026-10-30 14:23:32.068942224 +0000 UTC m=+1005.703888861"
Oct 30 14:23:32.964019 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:32.963983    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:33.050733 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:33.050687    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" event={"ID":"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f","Type":"ContainerStarted","Data":"0accb1593ddd5dcfa7aa76babb879e3d2d65f8587e5995b8eab82b904303a8c2"}
Oct 30 14:23:33.050899 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:33.050748    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" event={"ID":"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f","Type":"ContainerStarted","Data":"ed176fe6b06bc4c52d44eddf4e739f2dd6393f328ce60e4a44944d985af3553a"}
Oct 30 14:23:33.113286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:33.113223    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podStartSLOduration=2.113209744 podStartE2EDuration="2.113209744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:33.112380802 +0000 UTC m=+1006.747327422" watchObservedRunningTime="2026-10-30 14:23:33.113209744 +0000 UTC m=+1006.748156365"
Oct 30 14:23:33.722100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:33.722068    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:33.747392 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:33.747357    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 14:23:33.747666 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:33.747637    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 14:23:34.722873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:34.722843    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 14:23:34.723311 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:34.722892    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 14:23:35.722425 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:35.722392    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 14:23:35.722583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:35.722445    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 14:23:36.722926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:36.722893    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 14:23:36.723463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:36.722954    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 14:23:37.722834 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:37.722797    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Oct 30 14:23:37.722995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:37.722856    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Oct 30 14:23:38.929874 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:38.929843    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:38.930419 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:38.930393    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:38.931627 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:38.931605    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:23:40.964362 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:40.964318    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:40.977090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:40.977060    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:23:41.117751 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:23:41.117713    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:24:01.167174 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.167078    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"]
Oct 30 14:24:01.174785 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.174762    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.195220 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.195197    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"]
Oct 30 14:24:01.204916 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.204894    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-a5ddf3\"/\"distinct-2-w2-a5ddf3-kserve-self-signed-certs\""
Oct 30 14:24:01.261850 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.261826    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.261995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.261877    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.261995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.261971    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.262086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.262005    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.262086 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.262031    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2j7s\" (UniqueName: \"kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.262157 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.262126    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.363744 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.363707    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.363920 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.363786    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.363920 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.363817    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.363920 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.363850    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2j7s\" (UniqueName: \"kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.363920 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.363886    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.364126 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.364079    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.364198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.364160    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.364334 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.364311    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.364971 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.364946    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.369186 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.368103    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.369566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.369543    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.393073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.392525    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2j7s\" (UniqueName: \"kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s\") pod \"distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") " pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.491344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.490200    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:01.646273 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:24:01.643524    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:24:01.804964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.804885    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"]
Oct 30 14:24:01.809883 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.809861    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.835008 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.834675    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"]
Oct 30 14:24:01.837472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.837447    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"]
Oct 30 14:24:01.838310 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:24:01.838284    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf123465_5490_412c_83a8_55f85dd3d8a5.slice/crio-68a2f97c2709be43d43a31b4ec897b850fed80bc6f652e603b45f82a59e1e27c WatchSource:0}: Error finding container 68a2f97c2709be43d43a31b4ec897b850fed80bc6f652e603b45f82a59e1e27c: Status 404 returned error can't find the container with id 68a2f97c2709be43d43a31b4ec897b850fed80bc6f652e603b45f82a59e1e27c
Oct 30 14:24:01.844085 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.843589    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-1d36cf-openshift-default-dockercfg-shmkc\""
Oct 30 14:24:01.873920 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.873896    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874020 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.873937    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874069    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874141 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874121    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874152    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv5jc\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874186    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874323 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874227    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874385 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874330    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.874441 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.874382    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975459 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975424    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975459 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975462    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975520    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975548    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975575    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv5jc\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975605    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975639    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975707    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975761    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.975935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975915    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.976100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.975950    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.976100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.976086    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.976383 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.976357    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.976487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.976464    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.977811 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.977796    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.978083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.978064    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:01.999957 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:01.999930    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:02.000287 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.000268    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv5jc\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:02.123765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.123739    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:02.239260 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.239215    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" event={"ID":"df123465-5490-412c-83a8-55f85dd3d8a5","Type":"ContainerStarted","Data":"33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df"}
Oct 30 14:24:02.239645 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.239291    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" event={"ID":"df123465-5490-412c-83a8-55f85dd3d8a5","Type":"ContainerStarted","Data":"68a2f97c2709be43d43a31b4ec897b850fed80bc6f652e603b45f82a59e1e27c"}
Oct 30 14:24:02.284382 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.284337    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podStartSLOduration=1.284319849 podStartE2EDuration="1.284319849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:24:02.281882483 +0000 UTC m=+1035.916829114" watchObservedRunningTime="2026-10-30 14:24:02.284319849 +0000 UTC m=+1035.919266469"
Oct 30 14:24:02.458628 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.458601    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"]
Oct 30 14:24:02.461736 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:24:02.461708    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16dd2bf3_1d2a_4529_bd63_60f181ec75b9.slice/crio-0f412122375c0863d42c7dac2090dccc4680b96edf2cf46b53f439b2f5f10d06 WatchSource:0}: Error finding container 0f412122375c0863d42c7dac2090dccc4680b96edf2cf46b53f439b2f5f10d06: Status 404 returned error can't find the container with id 0f412122375c0863d42c7dac2090dccc4680b96edf2cf46b53f439b2f5f10d06
Oct 30 14:24:02.464194 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.464159    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:24:02.464319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.464220    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:24:02.464319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.464280    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:24:02.491419 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:02.491393    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:03.254656 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:03.254621    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" event={"ID":"16dd2bf3-1d2a-4529-bd63-60f181ec75b9","Type":"ContainerStarted","Data":"7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a"}
Oct 30 14:24:03.255053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:03.254676    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" event={"ID":"16dd2bf3-1d2a-4529-bd63-60f181ec75b9","Type":"ContainerStarted","Data":"0f412122375c0863d42c7dac2090dccc4680b96edf2cf46b53f439b2f5f10d06"}
Oct 30 14:24:03.316878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:03.316831    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podStartSLOduration=2.31681717 podStartE2EDuration="2.31681717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:24:03.315343037 +0000 UTC m=+1036.950289657" watchObservedRunningTime="2026-10-30 14:24:03.31681717 +0000 UTC m=+1036.951763789"
Oct 30 14:24:04.144360 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:04.144316    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:04.148412 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:04.148378    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 14:24:04.148541 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:04.148423    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 14:24:05.145271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:05.128546    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 14:24:05.145271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:05.128604    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 14:24:06.126549 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:06.126515    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 14:24:06.126813 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:06.126785    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 14:24:07.128562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:07.128524    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 14:24:07.129231 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:07.129197    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 14:24:08.141405 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:08.141367    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Oct 30 14:24:08.142028 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:08.141995    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Oct 30 14:24:09.406339 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:09.406303    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:09.407314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:09.407292    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:09.408479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:09.408453    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:24:11.491306 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:11.491274    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:11.510691 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:11.510664    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:12.315832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:12.315798    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:24:31.619355 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:24:31.619316    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:24:58.176445 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.176407    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"]
Oct 30 14:24:58.181009 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.180987    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.198355 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.198330    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"]
Oct 30 14:24:58.207261 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.207228    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:24:58.208001 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.207981    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:24:58.248079 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.248046    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.248204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.248085    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f78x\" (UniqueName: \"kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.248291 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.248213    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.349671 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.349634    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.349850 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.349746    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.349850 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.349789    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f78x\" (UniqueName: \"kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.350449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.350423    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.352126 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.352102    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.374702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.374673    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f78x\" (UniqueName: \"kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x\") pod \"maas-api-revoke-sub-dce4e691-crxn8\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.495952 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.495888    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:24:58.799172 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:58.799151    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"]
Oct 30 14:24:59.587633 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:59.587602    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8" event={"ID":"b40df1cd-eba4-47d1-a08e-a720d40b7d57","Type":"ContainerStarted","Data":"a0612730cab15d27d355e947a6dfcb9c9a8c9067c123ddc2258bd94df475b16f"}
Oct 30 14:24:59.587997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:59.587653    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8" event={"ID":"b40df1cd-eba4-47d1-a08e-a720d40b7d57","Type":"ContainerStarted","Data":"80b744a7f46fc66338fdf9a9e08c17a1297eb4581adba68a0d962e0de9826df7"}
Oct 30 14:24:59.630850 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:24:59.630805    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8" podStartSLOduration=1.630792762 podStartE2EDuration="1.630792762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:24:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:24:59.629408821 +0000 UTC m=+1093.264355439" watchObservedRunningTime="2026-10-30 14:24:59.630792762 +0000 UTC m=+1093.265739381"
Oct 30 14:25:00.594368 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:00.594328    4538 generic.go:356] "Generic (PLEG): container finished" podID="b40df1cd-eba4-47d1-a08e-a720d40b7d57" containerID="a0612730cab15d27d355e947a6dfcb9c9a8c9067c123ddc2258bd94df475b16f" exitCode=0
Oct 30 14:25:00.594742 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:00.594374    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8" event={"ID":"b40df1cd-eba4-47d1-a08e-a720d40b7d57","Type":"ContainerDied","Data":"a0612730cab15d27d355e947a6dfcb9c9a8c9067c123ddc2258bd94df475b16f"}
Oct 30 14:25:01.299776 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.299742    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"]
Oct 30 14:25:01.304059 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.304042    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.331528 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.331491    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"]
Oct 30 14:25:01.384398 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384360    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384398 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384404    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384638 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384478    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384638 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384532    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384715 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384654    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384715 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384698    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wf6b\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384802    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384881 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384850    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.384936 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.384878    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.385217 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.385200    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"]
Oct 30 14:25:01.388928 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.388912    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.414321 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.413692    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"]
Oct 30 14:25:01.486277 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486216    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.486450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486295    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.486450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486361    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.486450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486427    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.486595 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486472    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.486641 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486603    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.486641 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486625    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.486726 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486647    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.486726 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486647    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.486799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486782    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.486861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486822    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.486910 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486893    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.486959 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486928    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.487007 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.486962    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487039    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.487121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487058    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpknn\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.487121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487063    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487091    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487126    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wf6b\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487340    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487355    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487384    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.487618 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.487599    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.489187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.489160    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.489513 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.489493    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.514278 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.514227    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.514379 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.514327    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wf6b\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.589110 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589078    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589110 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589112    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589168    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589186    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpknn\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589287    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589363    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589420    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589445    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589484    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589584    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589829 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589789    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589887 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589837    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.589939 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.589895    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.590149 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.590132    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.591979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.591949    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.592309 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.592287    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.617801 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.617773    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:01.618223 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.618063    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.620543 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.620515    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpknn\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.629625 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:25:01.629596    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:25:01.708668 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.708633    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:01.749913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.749892    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:25:01.803414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.803383    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"]
Oct 30 14:25:01.804059 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.804038    4538 cpu_manager.go:414] "containerMap: removing container" podUID="b40df1cd-eba4-47d1-a08e-a720d40b7d57" containerName="revoke-keys"
Oct 30 14:25:01.804059 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.804059    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b40df1cd-eba4-47d1-a08e-a720d40b7d57" containerName="revoke-keys"
Oct 30 14:25:01.804214 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.804159    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="b40df1cd-eba4-47d1-a08e-a720d40b7d57" containerName="revoke-keys"
Oct 30 14:25:01.808011 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.807995    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.831026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.830996    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"]
Oct 30 14:25:01.842705 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.842641    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"]
Oct 30 14:25:01.846527 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.846506    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.876020 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.875992    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"]
Oct 30 14:25:01.894626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.894599    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca\") pod \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") "
Oct 30 14:25:01.894770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.894692    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca\") pod \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") "
Oct 30 14:25:01.894770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.894724    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x\" (UniqueName: \"kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x\") pod \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\" (UID: \"b40df1cd-eba4-47d1-a08e-a720d40b7d57\") "
Oct 30 14:25:01.895045 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895016    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca" pod "b40df1cd-eba4-47d1-a08e-a720d40b7d57" (UID: "b40df1cd-eba4-47d1-a08e-a720d40b7d57"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:25:01.895144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895051    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxxfk\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895195 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895161    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895260 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895225    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895381 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895356    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895481 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895462    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895528 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895514    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895648 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895632    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895684    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895737 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895717    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.895854 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.895840    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:01.896946 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.896927    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x" pod "b40df1cd-eba4-47d1-a08e-a720d40b7d57" (UID: "b40df1cd-eba4-47d1-a08e-a720d40b7d57"). InnerVolumeSpecName "kube-api-access-8f78x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:25:01.897206 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.897181    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca" pod "b40df1cd-eba4-47d1-a08e-a720d40b7d57" (UID: "b40df1cd-eba4-47d1-a08e-a720d40b7d57"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:25:01.943839 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.943818    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"]
Oct 30 14:25:01.946429 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:25:01.946405    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d530c1_005d_4542_975a_67c649280d31.slice/crio-88bcf4fe8d255fc05059cfc1199d05dfaed5d3b4f80c9ab7c4faf208e4f39a78 WatchSource:0}: Error finding container 88bcf4fe8d255fc05059cfc1199d05dfaed5d3b4f80c9ab7c4faf208e4f39a78: Status 404 returned error can't find the container with id 88bcf4fe8d255fc05059cfc1199d05dfaed5d3b4f80c9ab7c4faf208e4f39a78
Oct 30 14:25:01.948851 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.948822    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:01.948907 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.948880    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:01.948948 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.948906    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:01.997058 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997036    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997082    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997103    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997138    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997164    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.997314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997198    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997229    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.997314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997277    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.997508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997342    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997380    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.997508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997407    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997456    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997695 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997662    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997746 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997714    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997758    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.997837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997814    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.998061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997853    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.998061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997907    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.998061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.997917    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.998061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.998020    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.998061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.998051    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8tb\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:01.998387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.998084    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxxfk\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.998387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.998179    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b40df1cd-eba4-47d1-a08e-a720d40b7d57-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:01.998387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.998198    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f78x\" (UniqueName: \"kubernetes.io/projected/b40df1cd-eba4-47d1-a08e-a720d40b7d57-kube-api-access-8f78x\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:01.999059 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.999040    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:01.999964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:01.999941    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:02.000145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.000126    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:02.022240 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.022217    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:02.022452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.022432    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxxfk\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:02.032577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.032549    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"]
Oct 30 14:25:02.035141 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:25:02.035118    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9370c489_ee64_4ebe_a6cb_fa5349a7280b.slice/crio-4a6fd207c539cb7a5105dd67beda14ee7809e1140591135e571b5240f2497036 WatchSource:0}: Error finding container 4a6fd207c539cb7a5105dd67beda14ee7809e1140591135e571b5240f2497036: Status 404 returned error can't find the container with id 4a6fd207c539cb7a5105dd67beda14ee7809e1140591135e571b5240f2497036
Oct 30 14:25:02.037733 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.037704    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.037803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.037763    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.037803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.037791    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.099438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.099406    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.099553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.099472    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.099553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.099515    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.099660 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.099619    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100079    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100181    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100202    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100255    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100205    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100350    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100395    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.100421    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8tb\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.101106    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.101986 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.101294    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.102785 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.102764    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.103365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.103341    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.128642 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.128591    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.129078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.129054    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:02.138579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.138556    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8tb\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.166491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.166463    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:02.466048 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.465958    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"]
Oct 30 14:25:02.493286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.493217    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.493417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.493330    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.493417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.493376    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.516344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.516320    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"]
Oct 30 14:25:02.517302 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:25:02.517273    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388adf68_7b3f_4e81_b770_c468f5720ddf.slice/crio-9543c668931af5587af79d579c5ffacbfbd383c08fdbfab9a9d0f53b93cd1d9b WatchSource:0}: Error finding container 9543c668931af5587af79d579c5ffacbfbd383c08fdbfab9a9d0f53b93cd1d9b: Status 404 returned error can't find the container with id 9543c668931af5587af79d579c5ffacbfbd383c08fdbfab9a9d0f53b93cd1d9b
Oct 30 14:25:02.519826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.519797    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.519889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.519873    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.519939 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.519914    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:02.616235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.616210    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" event={"ID":"388adf68-7b3f-4e81-b770-c468f5720ddf","Type":"ContainerStarted","Data":"9543c668931af5587af79d579c5ffacbfbd383c08fdbfab9a9d0f53b93cd1d9b"}
Oct 30 14:25:02.617745 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.617678    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" event={"ID":"c3091838-d266-4134-9f34-757353d9127c","Type":"ContainerStarted","Data":"0d907ec4cb775bc2e389b3e8bb831b22602a312c1910c25695a60cc98959ae9a"}
Oct 30 14:25:02.620775 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.620748    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" event={"ID":"57d530c1-005d-4542-975a-67c649280d31","Type":"ContainerStarted","Data":"77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08"}
Oct 30 14:25:02.621138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.620793    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" event={"ID":"57d530c1-005d-4542-975a-67c649280d31","Type":"ContainerStarted","Data":"88bcf4fe8d255fc05059cfc1199d05dfaed5d3b4f80c9ab7c4faf208e4f39a78"}
Oct 30 14:25:02.622436 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.622411    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"
Oct 30 14:25:02.622553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.622409    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8" event={"ID":"b40df1cd-eba4-47d1-a08e-a720d40b7d57","Type":"ContainerDied","Data":"80b744a7f46fc66338fdf9a9e08c17a1297eb4581adba68a0d962e0de9826df7"}
Oct 30 14:25:02.622553 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.622516    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80b744a7f46fc66338fdf9a9e08c17a1297eb4581adba68a0d962e0de9826df7"
Oct 30 14:25:02.628413 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.628383    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" event={"ID":"9370c489-ee64-4ebe-a6cb-fa5349a7280b","Type":"ContainerStarted","Data":"ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9"}
Oct 30 14:25:02.628599 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.628578    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" event={"ID":"9370c489-ee64-4ebe-a6cb-fa5349a7280b","Type":"ContainerStarted","Data":"4a6fd207c539cb7a5105dd67beda14ee7809e1140591135e571b5240f2497036"}
Oct 30 14:25:02.709042 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.709012    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:02.799341 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.770454    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podStartSLOduration=1.7704306920000001 podStartE2EDuration="1.770430692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:02.685264847 +0000 UTC m=+1096.320211467" watchObservedRunningTime="2026-10-30 14:25:02.770430692 +0000 UTC m=+1096.405377312"
Oct 30 14:25:02.799341 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:02.771236    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podStartSLOduration=1.77122335 podStartE2EDuration="1.77122335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:02.761362711 +0000 UTC m=+1096.396309338" watchObservedRunningTime="2026-10-30 14:25:02.77122335 +0000 UTC m=+1096.406169971"
Oct 30 14:25:03.628630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.628082    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:03.628630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.628230    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:03.628630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.628294    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:03.676270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.666983    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" event={"ID":"388adf68-7b3f-4e81-b770-c468f5720ddf","Type":"ContainerStarted","Data":"fff19bd7ed9ff8d30a8a050c7b057c690cf481c1bd60757a43425f7c4f40c4ab"}
Oct 30 14:25:03.698271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.696824    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" event={"ID":"c3091838-d266-4134-9f34-757353d9127c","Type":"ContainerStarted","Data":"1cd3d54127db2d660eb303c9162283dc1e0178162c9e1d4ae344db6aa0e2806a"}
Oct 30 14:25:03.712877 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.712842    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:03.713101 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.713076    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:03.886329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.879873    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podStartSLOduration=2.879849507 podStartE2EDuration="2.879849507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:03.763505217 +0000 UTC m=+1097.398451846" watchObservedRunningTime="2026-10-30 14:25:03.879849507 +0000 UTC m=+1097.514796129"
Oct 30 14:25:03.886329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:03.880189    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podStartSLOduration=2.880179688 podStartE2EDuration="2.880179688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:03.851228075 +0000 UTC m=+1097.486174696" watchObservedRunningTime="2026-10-30 14:25:03.880179688 +0000 UTC m=+1097.515126321"
Oct 30 14:25:04.134740 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.134706    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:04.135065 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.135041    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:04.135267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.135218    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:04.169155 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.169066    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:04.170238 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.170212    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:04.170448 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.170422    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:04.445596 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.445496    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:04.487424 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.487375    4538 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:04.488006 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.487977    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:04.662279 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.661616    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:04.662279 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.661842    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:04.742058 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.731573    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:04.742058 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:04.731632    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:05.096381 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.096334    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.105269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.101638    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.139709 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.117733    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.140402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.139734    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:05.140583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.140554    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:05.155490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.155449    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.172172 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.172121    4538 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.176523 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.172526    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:05.176707 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.176683    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:05.232271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.196947    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 14:25:05.277273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.277208    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 14:25:05.315270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.307186    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": context deadline exceeded"
Oct 30 14:25:05.344272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.338445    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.412329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.411808    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.447270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.446314    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 14:25:05.447270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.446761    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:25:05.495338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.494448    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:05.495338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.494856    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:25:05.648270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.647449    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:05.648270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.647517    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:05.801958 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:05.801859    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:06.063441 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.063332    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:06.171275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.165867    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:06.171275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.166222    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.174343    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.174693    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.176775    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.176821    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.176917    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.176969    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.177003    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.177039    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.178155    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:06.179267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.178202    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:06.206062 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.204056    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:06.206062 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.204458    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:25:06.312375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.312328    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Oct 30 14:25:06.341369 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.327465    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:25:06.396286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.355075    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:06.396286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.361326    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:25:06.396286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.363401    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded"
Oct 30 14:25:06.396286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.389742    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:25:06.412007 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.411958    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 14:25:06.433300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.412496    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:25:06.606482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.605374    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 14:25:06.645269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.622596    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:06.645269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.622665    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:06.645670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.645640    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:06.735319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.713909    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:06.746280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:06.738970    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:07.161552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.032354    4538 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.161552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.144444    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:07.161552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.144506    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:07.196272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.170083    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": context deadline exceeded"
Oct 30 14:25:07.196272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.170527    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": context deadline exceeded"
Oct 30 14:25:07.196272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.170878    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:07.196272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.170915    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:07.196272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.194052    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.196272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.194440    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Oct 30 14:25:07.222287 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.220346    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": context deadline exceeded"
Oct 30 14:25:07.345273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.333785    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.388399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.360335    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.388399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.364311    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.416898 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.416801    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded"
Oct 30 14:25:07.630397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.629184    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.630397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.629960    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:07.630397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.630000    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:07.693324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.667350    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:07.792963 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.792932    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:07.793227 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.793203    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:07.920448 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:07.920417    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:25:08.156267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.154766    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:08.156267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.155733    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:08.181266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.173360    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.197270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.188351    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.197270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.190365    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:08.197270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.190513    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:08.211270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.209653    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.213267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.213197    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": context deadline exceeded"
Oct 30 14:25:08.227919 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.227873    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.324407 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.323336    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:25:08.348535 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.348492    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.505324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.504554    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.505324 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.505045    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": context deadline exceeded"
Oct 30 14:25:08.621271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.620630    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:08.621271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.620691    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:08.653275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.641128    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:08.688073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.688041    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:25:08.712988 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.712957    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:08.713214 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:08.713190    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:09.073275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.051159    4538 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/health\": context deadline exceeded"
Oct 30 14:25:09.073275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.061641    4538 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/health\": context deadline exceeded"
Oct 30 14:25:09.199271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.086070    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:25:09.199271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.118574    4538 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/health\": context deadline exceeded"
Oct 30 14:25:09.214742 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.214711    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:25:09.235282 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.227417    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main" probeResult="failure" output="Get \"https://10.133.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:09.235282 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.227806    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:09.263283 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.258384    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:09.301385 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.301350    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:09.315396 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.315358    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:09.323346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.323277    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:25:09.330272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.329330    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:09.341264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.338358    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:09.341264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.338407    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:09.410667 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.410630    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:09.512474 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.512447    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:25:09.513184 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.513157    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:25:09.604578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.603837    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:25:09.607555 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.606953    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:25:09.620190 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.620160    4538 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Oct 30 14:25:09.620331 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.620211    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Oct 30 14:25:09.622020 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.622003    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:25:09.709487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.709450    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Oct 30 14:25:09.709673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:09.709506    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Oct 30 14:25:10.130109 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.130071    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:25:10.130442 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.130154    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:25:10.168035 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.167906    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Oct 30 14:25:10.168035 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.167959    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Oct 30 14:25:10.714277 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.714231    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:10.714851 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.714782    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:10.715606 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.715582    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:25:10.885015 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.884569    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:10.886498 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.886475    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:10.888448 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:10.888422    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:25:11.576890 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:11.576861    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:11.577488 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:11.577468    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:11.578952 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:11.578930    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:25:11.696472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:11.696420    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:11.697862 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:11.697837    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:11.699065 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:11.699043    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:25:16.390396 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.390360    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"]
Oct 30 14:25:16.403479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.403447    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.430786 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.430757    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"]
Oct 30 14:25:16.510859 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.510829    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.510868    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.510898    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.511063    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511214 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.511188    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511291 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.511225    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511358 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.511301    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511433 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.511417    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.511490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.511474    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9fz\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612502    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612696 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612537    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612696 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612560    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612696 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612606    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612696 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612671    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612696 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612690    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612712    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612870    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612958    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9fz\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.612998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.612964    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.613187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.613075    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.613321 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.613299    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.613597 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.613579    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.613664 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.613651    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.615393 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.615369    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.615615 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.615599    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.639517 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.639482    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.639673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.639655    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9fz\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:16.717819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:16.717757    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:17.038236 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.038212    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"]
Oct 30 14:25:17.040166 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:25:17.040138    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ef9b3f_d7e1_4803_9ed7_0353861312b9.slice/crio-0e46fb86fd44afb6e8253a23458d509f2784cf1edab2ba0df8a0a5842e111d03 WatchSource:0}: Error finding container 0e46fb86fd44afb6e8253a23458d509f2784cf1edab2ba0df8a0a5842e111d03: Status 404 returned error can't find the container with id 0e46fb86fd44afb6e8253a23458d509f2784cf1edab2ba0df8a0a5842e111d03
Oct 30 14:25:17.042511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.042481    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:17.042581 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.042539    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:17.042581 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.042565    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:25:17.472983 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.472949    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" event={"ID":"19ef9b3f-d7e1-4803-9ed7-0353861312b9","Type":"ContainerStarted","Data":"72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7"}
Oct 30 14:25:17.473466 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.473003    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" event={"ID":"19ef9b3f-d7e1-4803-9ed7-0353861312b9","Type":"ContainerStarted","Data":"0e46fb86fd44afb6e8253a23458d509f2784cf1edab2ba0df8a0a5842e111d03"}
Oct 30 14:25:17.523599 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.523551    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podStartSLOduration=1.523519064 podStartE2EDuration="1.523519064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:17.520410188 +0000 UTC m=+1111.155356808" watchObservedRunningTime="2026-10-30 14:25:17.523519064 +0000 UTC m=+1111.158465752"
Oct 30 14:25:17.718344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:17.718311    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:18.719620 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:18.719584    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 14:25:18.720002 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:18.719643    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 14:25:19.718592 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:19.718442    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 14:25:19.718592 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:19.718511    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 14:25:19.927270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:19.921547    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"]
Oct 30 14:25:19.942635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:19.942594    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"]
Oct 30 14:25:20.721270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:20.720868    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 14:25:20.721270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:20.720937    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 14:25:21.404270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:21.403916    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:21.718404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:21.718313    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 14:25:21.718567 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:21.718391    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 14:25:22.718286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:22.718229    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 14:25:22.718643 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:22.718303    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 14:25:23.718194 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:23.718158    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Oct 30 14:25:23.718414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:23.718221    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Oct 30 14:25:25.759455 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:25.759421    4538 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 14:25:25.760115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:25.760082    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:25.859449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:25.859420    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:25.860018 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:25.859996    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:25.860907 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:25.860878    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:25:30.000100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.000021    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"]
Oct 30 14:25:30.004327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.004309    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.025123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.025099    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"]
Oct 30 14:25:30.054987 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.054960    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:25:30.055211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.055189    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:25:30.092863 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.092838    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.093011 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.092994    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.093079 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.093067    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mm5k\" (UniqueName: \"kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.194769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.194745    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mm5k\" (UniqueName: \"kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.194886 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.194850    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.195031 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.195014    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.195673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.195648    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.197063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.197036    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.223588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.223563    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mm5k\" (UniqueName: \"kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k\") pod \"maas-api-revoke-sub-02dbe498-4tqcc\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.317702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.317637    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:30.623794 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:30.623762    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"]
Oct 30 14:25:30.625978 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:25:30.625954    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c8ce2a_8c95_41e2_b62b_b86c69b8c16e.slice/crio-a898afaa75a2b9a24addbb7caa50ceeb2acbb69611a004924a58374cd9a574f3 WatchSource:0}: Error finding container a898afaa75a2b9a24addbb7caa50ceeb2acbb69611a004924a58374cd9a574f3: Status 404 returned error can't find the container with id a898afaa75a2b9a24addbb7caa50ceeb2acbb69611a004924a58374cd9a574f3
Oct 30 14:25:31.597337 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:31.597291    4538 generic.go:356] "Generic (PLEG): container finished" podID="b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" containerID="7e5d18eb1c3cf826c876e6d9bbfe5abb8238249016e586d0b6e429049c7c51c5" exitCode=0
Oct 30 14:25:31.597752 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:31.597357    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc" event={"ID":"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e","Type":"ContainerDied","Data":"7e5d18eb1c3cf826c876e6d9bbfe5abb8238249016e586d0b6e429049c7c51c5"}
Oct 30 14:25:31.597752 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:31.597442    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc" event={"ID":"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e","Type":"ContainerStarted","Data":"a898afaa75a2b9a24addbb7caa50ceeb2acbb69611a004924a58374cd9a574f3"}
Oct 30 14:25:31.620425 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:25:31.620395    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:25:32.771861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.771830    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:32.928383 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.928308    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca\") pod \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") "
Oct 30 14:25:32.928383 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.928360    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca\") pod \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") "
Oct 30 14:25:32.928632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.928613    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k\" (UniqueName: \"kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k\") pod \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\" (UID: \"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e\") "
Oct 30 14:25:32.928697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.928670    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca" pod "b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" (UID: "b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:25:32.929079 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.929062    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:32.930584 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.930553    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca" pod "b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" (UID: "b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:25:32.930703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:32.930608    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k" pod "b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" (UID: "b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e"). InnerVolumeSpecName "kube-api-access-4mm5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:25:33.030344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:33.030307    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mm5k\" (UniqueName: \"kubernetes.io/projected/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-kube-api-access-4mm5k\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:33.030344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:33.030337    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:33.609204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:33.609175    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"
Oct 30 14:25:33.609403 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:33.609175    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc" event={"ID":"b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e","Type":"ContainerDied","Data":"a898afaa75a2b9a24addbb7caa50ceeb2acbb69611a004924a58374cd9a574f3"}
Oct 30 14:25:33.609403 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:33.609296    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a898afaa75a2b9a24addbb7caa50ceeb2acbb69611a004924a58374cd9a574f3"
Oct 30 14:25:35.522753 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.522705    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main" containerID="cri-o://ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e" gracePeriod=45
Oct 30 14:25:35.715285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.714716    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main" containerID="cri-o://33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df" gracePeriod=45
Oct 30 14:25:35.845156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.845133    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:25:35.961350 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.961318    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:25:35.965378 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965348    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir\") pod \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") "
Oct 30 14:25:35.965489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965423    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home\") pod \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") "
Oct 30 14:25:35.965489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965457    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm\") pod \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") "
Oct 30 14:25:35.965613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965544    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs\") pod \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") "
Oct 30 14:25:35.965613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965578    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir" pod "0c4de9db-4347-460e-9f3c-bcdc9a1ec735" (UID: "0c4de9db-4347-460e-9f3c-bcdc9a1ec735"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:35.965705 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965616    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache\") pod \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") "
Oct 30 14:25:35.965705 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965656    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2\" (UniqueName: \"kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2\") pod \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\" (UID: \"0c4de9db-4347-460e-9f3c-bcdc9a1ec735\") "
Oct 30 14:25:35.965705 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965677    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home" pod "0c4de9db-4347-460e-9f3c-bcdc9a1ec735" (UID: "0c4de9db-4347-460e-9f3c-bcdc9a1ec735"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:35.965705 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965694    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache\") pod \"df123465-5490-412c-83a8-55f85dd3d8a5\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") "
Oct 30 14:25:35.965959 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965740    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home\") pod \"df123465-5490-412c-83a8-55f85dd3d8a5\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") "
Oct 30 14:25:35.965959 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.965800    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs\" (UniqueName: \"kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs\") pod \"df123465-5490-412c-83a8-55f85dd3d8a5\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") "
Oct 30 14:25:35.966142 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.966107    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home" pod "df123465-5490-412c-83a8-55f85dd3d8a5" (UID: "df123465-5490-412c-83a8-55f85dd3d8a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:35.966331 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.966312    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:35.966331 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.966330    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:35.966470 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.966339    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:35.966470 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.966016    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache" pod "0c4de9db-4347-460e-9f3c-bcdc9a1ec735" (UID: "0c4de9db-4347-460e-9f3c-bcdc9a1ec735"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:35.967277 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.967230    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache" pod "df123465-5490-412c-83a8-55f85dd3d8a5" (UID: "df123465-5490-412c-83a8-55f85dd3d8a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:35.968100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.968063    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs" pod "0c4de9db-4347-460e-9f3c-bcdc9a1ec735" (UID: "0c4de9db-4347-460e-9f3c-bcdc9a1ec735"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:25:35.968319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.968297    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs" pod "df123465-5490-412c-83a8-55f85dd3d8a5" (UID: "df123465-5490-412c-83a8-55f85dd3d8a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:25:35.968408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.968318    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2" pod "0c4de9db-4347-460e-9f3c-bcdc9a1ec735" (UID: "0c4de9db-4347-460e-9f3c-bcdc9a1ec735"). InnerVolumeSpecName "kube-api-access-lvrt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:25:35.968981 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:35.968961    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm" pod "0c4de9db-4347-460e-9f3c-bcdc9a1ec735" (UID: "0c4de9db-4347-460e-9f3c-bcdc9a1ec735"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:36.066778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.066693    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s\" (UniqueName: \"kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s\") pod \"df123465-5490-412c-83a8-55f85dd3d8a5\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") "
Oct 30 14:25:36.066778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.066730    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir\") pod \"df123465-5490-412c-83a8-55f85dd3d8a5\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") "
Oct 30 14:25:36.066778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.066757    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm\") pod \"df123465-5490-412c-83a8-55f85dd3d8a5\" (UID: \"df123465-5490-412c-83a8-55f85dd3d8a5\") "
Oct 30 14:25:36.067129 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067018    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir" pod "df123465-5490-412c-83a8-55f85dd3d8a5" (UID: "df123465-5490-412c-83a8-55f85dd3d8a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:36.067183 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067155    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.067183 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067175    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvrt2\" (UniqueName: \"kubernetes.io/projected/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-kube-api-access-lvrt2\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.067263 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067194    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.067263 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067212    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df123465-5490-412c-83a8-55f85dd3d8a5-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.067263 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067225    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.067263 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067235    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.067263 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.067260    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c4de9db-4347-460e-9f3c-bcdc9a1ec735-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.068868 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.068842    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s" pod "df123465-5490-412c-83a8-55f85dd3d8a5" (UID: "df123465-5490-412c-83a8-55f85dd3d8a5"). InnerVolumeSpecName "kube-api-access-t2j7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:25:36.068971 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.068875    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm" pod "df123465-5490-412c-83a8-55f85dd3d8a5" (UID: "df123465-5490-412c-83a8-55f85dd3d8a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:36.168312 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.168284    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df123465-5490-412c-83a8-55f85dd3d8a5-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.168312 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.168312    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2j7s\" (UniqueName: \"kubernetes.io/projected/df123465-5490-412c-83a8-55f85dd3d8a5-kube-api-access-t2j7s\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:36.626476 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.626449    4538 generic.go:356] "Generic (PLEG): container finished" podID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerID="ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e" exitCode=0
Oct 30 14:25:36.626893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.626487    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"
Oct 30 14:25:36.626893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.626531    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" event={"ID":"0c4de9db-4347-460e-9f3c-bcdc9a1ec735","Type":"ContainerDied","Data":"ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e"}
Oct 30 14:25:36.626893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.626584    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g" event={"ID":"0c4de9db-4347-460e-9f3c-bcdc9a1ec735","Type":"ContainerDied","Data":"d637ed490c46931cd856d01579fdb2039b0017b84e488e6404f818d7bea0d9d7"}
Oct 30 14:25:36.626893 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.626607    4538 scope.go:122] "RemoveContainer" containerID="ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e"
Oct 30 14:25:36.627939 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.627911    4538 generic.go:356] "Generic (PLEG): container finished" podID="df123465-5490-412c-83a8-55f85dd3d8a5" containerID="33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df" exitCode=0
Oct 30 14:25:36.628002 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.627973    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"
Oct 30 14:25:36.628064 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.628041    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" event={"ID":"df123465-5490-412c-83a8-55f85dd3d8a5","Type":"ContainerDied","Data":"33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df"}
Oct 30 14:25:36.628105 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.628086    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2" event={"ID":"df123465-5490-412c-83a8-55f85dd3d8a5","Type":"ContainerDied","Data":"68a2f97c2709be43d43a31b4ec897b850fed80bc6f652e603b45f82a59e1e27c"}
Oct 30 14:25:36.637921 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.637895    4538 scope.go:122] "RemoveContainer" containerID="ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e"
Oct 30 14:25:36.638175 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:25:36.638154    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e\": container with ID starting with ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e not found: ID does not exist" containerID="ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e"
Oct 30 14:25:36.638229 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.638185    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e"} err="failed to get container status \"ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e\": rpc error: code = NotFound desc = could not find container \"ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e\": container with ID starting with ef451368f647ff8abe07b6d23837ba54c5f3c516178100930148f8b0a4423d7e not found: ID does not exist"
Oct 30 14:25:36.638229 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.638202    4538 scope.go:122] "RemoveContainer" containerID="33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df"
Oct 30 14:25:36.646630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.646615    4538 scope.go:122] "RemoveContainer" containerID="33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df"
Oct 30 14:25:36.646867 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:25:36.646849    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df\": container with ID starting with 33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df not found: ID does not exist" containerID="33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df"
Oct 30 14:25:36.646932 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.646876    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df"} err="failed to get container status \"33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df\": rpc error: code = NotFound desc = could not find container \"33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df\": container with ID starting with 33c5bc0d520e87e1ece8d79f0c87c0131eab2895f9db2d735f846cc4282ba1df not found: ID does not exist"
Oct 30 14:25:36.687408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.687372    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"]
Oct 30 14:25:36.693060 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.693035    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/simulator-w2-a5ddf3-kserve-6c76cff79d-5tp8g"]
Oct 30 14:25:36.725489 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.725459    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"]
Oct 30 14:25:36.729412 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:36.729385    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-a5ddf3/distinct-2-w2-a5ddf3-kserve-bcf6b86df-ngvb2"]
Oct 30 14:25:38.582294 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:38.582231    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" path="/var/lib/kubelet/pods/0c4de9db-4347-460e-9f3c-bcdc9a1ec735/volumes"
Oct 30 14:25:38.582751 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:38.582735    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" path="/var/lib/kubelet/pods/df123465-5490-412c-83a8-55f85dd3d8a5/volumes"
Oct 30 14:25:40.127268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:40.126355    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"]
Oct 30 14:25:41.635271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:41.634341    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded"
Oct 30 14:25:41.675270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:41.674278    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 14:25:42.172387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.172338    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:42.340688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.340642    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:42.510320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.509407    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:42.594268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.593496    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 14:25:42.594268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.593556    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:42.638550 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.638505    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:25:42.639784 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.639760    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:25:42.675364 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.675332    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Oct 30 14:25:42.676132 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.676111    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:25:42.755403 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.754944    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:25:42.828318 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:42.827384    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:25:45.861791 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:45.861753    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"]
Oct 30 14:25:46.161750 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:46.161672    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"]
Oct 30 14:25:46.170754 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:46.170719    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"]
Oct 30 14:25:46.189782 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:46.182648    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"]
Oct 30 14:25:50.862350 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:50.862308    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" containerName="payload-pre-processing" containerID="cri-o://b347cb3984fe65060b39c743dddedb2b10b1ff63281c285e02741565da08a0a2" gracePeriod=25
Oct 30 14:25:55.170401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.170338    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main" containerID="cri-o://db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235" gracePeriod=45
Oct 30 14:25:55.401638 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.401606    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"]
Oct 30 14:25:55.414636 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.414606    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"]
Oct 30 14:25:55.460558 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.460533    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:25:55.563354 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.563321    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir\") pod \"81ec0b99-917e-43c4-a034-2332e47bf029\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") "
Oct 30 14:25:55.563872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.563853    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm\") pod \"81ec0b99-917e-43c4-a034-2332e47bf029\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") "
Oct 30 14:25:55.564132 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.564114    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r\" (UniqueName: \"kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r\") pod \"81ec0b99-917e-43c4-a034-2332e47bf029\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") "
Oct 30 14:25:55.564344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.564328    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home\") pod \"81ec0b99-917e-43c4-a034-2332e47bf029\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") "
Oct 30 14:25:55.564482 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.564468    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs\" (UniqueName: \"kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs\") pod \"81ec0b99-917e-43c4-a034-2332e47bf029\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") "
Oct 30 14:25:55.564619 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.564605    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache\") pod \"81ec0b99-917e-43c4-a034-2332e47bf029\" (UID: \"81ec0b99-917e-43c4-a034-2332e47bf029\") "
Oct 30 14:25:55.566092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.566035    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home" pod "81ec0b99-917e-43c4-a034-2332e47bf029" (UID: "81ec0b99-917e-43c4-a034-2332e47bf029"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:55.566335 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.566291    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir" pod "81ec0b99-917e-43c4-a034-2332e47bf029" (UID: "81ec0b99-917e-43c4-a034-2332e47bf029"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:55.566599 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.566578    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache" pod "81ec0b99-917e-43c4-a034-2332e47bf029" (UID: "81ec0b99-917e-43c4-a034-2332e47bf029"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:55.568797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.568767    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm" pod "81ec0b99-917e-43c4-a034-2332e47bf029" (UID: "81ec0b99-917e-43c4-a034-2332e47bf029"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:25:55.568896 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.568850    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r" pod "81ec0b99-917e-43c4-a034-2332e47bf029" (UID: "81ec0b99-917e-43c4-a034-2332e47bf029"). InnerVolumeSpecName "kube-api-access-47f4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:25:55.569115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.569092    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs" pod "81ec0b99-917e-43c4-a034-2332e47bf029" (UID: "81ec0b99-917e-43c4-a034-2332e47bf029"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:25:55.666354 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.666328    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ec0b99-917e-43c4-a034-2332e47bf029-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:55.666354 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.666350    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:55.666354 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.666359    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:55.666583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.666366    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:55.666583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.666374    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47f4r\" (UniqueName: \"kubernetes.io/projected/81ec0b99-917e-43c4-a034-2332e47bf029-kube-api-access-47f4r\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:55.666583 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.666382    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81ec0b99-917e-43c4-a034-2332e47bf029-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:25:55.947780 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.947746    4538 generic.go:356] "Generic (PLEG): container finished" podID="81ec0b99-917e-43c4-a034-2332e47bf029" containerID="db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235" exitCode=0
Oct 30 14:25:55.947938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.947814    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"
Oct 30 14:25:55.947938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.947826    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" event={"ID":"81ec0b99-917e-43c4-a034-2332e47bf029","Type":"ContainerDied","Data":"db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235"}
Oct 30 14:25:55.947938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.947889    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg" event={"ID":"81ec0b99-917e-43c4-a034-2332e47bf029","Type":"ContainerDied","Data":"41c45f89ce8a52dedc6438f2d194f1730f8878217a7dc870c2eddb937304dfb8"}
Oct 30 14:25:55.947938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.947915    4538 scope.go:122] "RemoveContainer" containerID="db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235"
Oct 30 14:25:55.959646 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.959470    4538 scope.go:122] "RemoveContainer" containerID="db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235"
Oct 30 14:25:55.959993 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:25:55.959965    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235\": container with ID starting with db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235 not found: ID does not exist" containerID="db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235"
Oct 30 14:25:55.960123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:55.960004    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235"} err="failed to get container status \"db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235\": rpc error: code = NotFound desc = could not find container \"db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235\": container with ID starting with db12ee594af56ec554fc4627dd9f6ac3b5cb0de96dfbc4622681a51404afa235 not found: ID does not exist"
Oct 30 14:25:56.030042 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:56.029939    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"]
Oct 30 14:25:56.041944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:56.041913    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-24dfd7/premium-w3-24dfd7-kserve-75c8ffdb44-5qstg"]
Oct 30 14:25:56.589571 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:56.589537    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" path="/var/lib/kubelet/pods/81ec0b99-917e-43c4-a034-2332e47bf029/volumes"
Oct 30 14:25:56.895455 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:56.895372    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:25:58.524016 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.523980    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"]
Oct 30 14:25:58.524661 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524643    4538 cpu_manager.go:414] "containerMap: removing container" podUID="b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" containerName="revoke-keys"
Oct 30 14:25:58.524713 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524662    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" containerName="revoke-keys"
Oct 30 14:25:58.524713 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524686    4538 cpu_manager.go:414] "containerMap: removing container" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main"
Oct 30 14:25:58.524713 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524692    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main"
Oct 30 14:25:58.524713 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524699    4538 cpu_manager.go:414] "containerMap: removing container" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main"
Oct 30 14:25:58.524713 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524704    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main"
Oct 30 14:25:58.524872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524725    4538 cpu_manager.go:414] "containerMap: removing container" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main"
Oct 30 14:25:58.524872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524731    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main"
Oct 30 14:25:58.524872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524821    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="81ec0b99-917e-43c4-a034-2332e47bf029" containerName="main"
Oct 30 14:25:58.524872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524829    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="df123465-5490-412c-83a8-55f85dd3d8a5" containerName="main"
Oct 30 14:25:58.524872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524839    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c4de9db-4347-460e-9f3c-bcdc9a1ec735" containerName="main"
Oct 30 14:25:58.524872 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.524846    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" containerName="revoke-keys"
Oct 30 14:25:58.529573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.529552    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.549108 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.549081    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"]
Oct 30 14:25:58.557776 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.557752    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:25:58.557962 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.557937    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:25:58.612408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.612375    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.612563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.612534    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.612617 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.612602    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhkrp\" (UniqueName: \"kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.713383 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.713351    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.713546 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.713427    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhkrp\" (UniqueName: \"kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.713546 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.713525    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.714158 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.714138    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.715730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.715709    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.739469 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.739437    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhkrp\" (UniqueName: \"kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp\") pod \"maas-api-revoke-sub-4c0b2e1d-dlr9f\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:58.845906 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:58.845878    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:25:59.176984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.160331    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"]
Oct 30 14:25:59.783827 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.783741    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"]
Oct 30 14:25:59.784312 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.783973    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy" containerID="cri-o://77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08" gracePeriod=30
Oct 30 14:25:59.798294 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.798238    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"]
Oct 30 14:25:59.798562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.798499    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy" containerID="cri-o://a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc" gracePeriod=30
Oct 30 14:25:59.981174 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.981134    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f" event={"ID":"db69ea2b-8e84-4aa5-b523-dc69b18fa006","Type":"ContainerStarted","Data":"ae0e5d0ce8021f242718d3de86e2a6487969cbff61e1c2106fa1ec7dd25832ff"}
Oct 30 14:25:59.981358 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:25:59.981199    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f" event={"ID":"db69ea2b-8e84-4aa5-b523-dc69b18fa006","Type":"ContainerStarted","Data":"f6f115e8b8f11e714741a6b25f0c56369f97a869bfa9e2de8a8a869a4592d4b0"}
Oct 30 14:26:00.028939 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:00.028880    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f" podStartSLOduration=2.028859247 podStartE2EDuration="2.028859247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:00.0269337 +0000 UTC m=+1153.661880336" watchObservedRunningTime="2026-10-30 14:26:00.028859247 +0000 UTC m=+1153.663805868"
Oct 30 14:26:00.988865 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:00.988830    4538 generic.go:356] "Generic (PLEG): container finished" podID="db69ea2b-8e84-4aa5-b523-dc69b18fa006" containerID="ae0e5d0ce8021f242718d3de86e2a6487969cbff61e1c2106fa1ec7dd25832ff" exitCode=0
Oct 30 14:26:00.989275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:00.988863    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f" event={"ID":"db69ea2b-8e84-4aa5-b523-dc69b18fa006","Type":"ContainerDied","Data":"ae0e5d0ce8021f242718d3de86e2a6487969cbff61e1c2106fa1ec7dd25832ff"}
Oct 30 14:26:01.102426 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.102393    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"]
Oct 30 14:26:01.190683 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.190648    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" containerID="cri-o://1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438" gracePeriod=45
Oct 30 14:26:01.198052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.198013    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main" containerID="cri-o://2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15" gracePeriod=45
Oct 30 14:26:01.220459 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.220424    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" containerID="cri-o://3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd" gracePeriod=45
Oct 30 14:26:01.230013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.229979    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": dial tcp 10.133.0.55:8000: connect: connection refused"
Oct 30 14:26:01.334531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.334493    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": dial tcp 10.133.0.44:8000: connect: connection refused"
Oct 30 14:26:01.549757 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.549734    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:26:01.554399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.554372    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:26:01.566535 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.566360    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:26:01.627231 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:01.627196    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:26:01.653293 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653239    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home\") pod \"45e08735-ec07-4a61-aef4-0703e558413f\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") "
Oct 30 14:26:01.653460 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653353    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache\") pod \"20f273f4-027a-43a0-9347-f065adbec5de\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") "
Oct 30 14:26:01.653460 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653395    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb\" (UniqueName: \"kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb\") pod \"8fd5733f-0623-4401-b880-46957dca3a4a\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") "
Oct 30 14:26:01.653460 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653436    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs\" (UniqueName: \"kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs\") pod \"20f273f4-027a-43a0-9347-f065adbec5de\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") "
Oct 30 14:26:01.653662 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653506    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz\" (UniqueName: \"kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz\") pod \"45e08735-ec07-4a61-aef4-0703e558413f\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") "
Oct 30 14:26:01.653662 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653578    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs\") pod \"45e08735-ec07-4a61-aef4-0703e558413f\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") "
Oct 30 14:26:01.653882 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.653846    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir" pod "45e08735-ec07-4a61-aef4-0703e558413f" (UID: "45e08735-ec07-4a61-aef4-0703e558413f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.654049 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654031    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home" pod "45e08735-ec07-4a61-aef4-0703e558413f" (UID: "45e08735-ec07-4a61-aef4-0703e558413f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.654220 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654198    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache" pod "20f273f4-027a-43a0-9347-f065adbec5de" (UID: "20f273f4-027a-43a0-9347-f065adbec5de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.654503 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654468    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir\") pod \"45e08735-ec07-4a61-aef4-0703e558413f\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") "
Oct 30 14:26:01.654590 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654566    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache\") pod \"45e08735-ec07-4a61-aef4-0703e558413f\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") "
Oct 30 14:26:01.654652 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654617    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache\") pod \"8fd5733f-0623-4401-b880-46957dca3a4a\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") "
Oct 30 14:26:01.654703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654685    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir\") pod \"20f273f4-027a-43a0-9347-f065adbec5de\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") "
Oct 30 14:26:01.654762 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654728    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm\") pod \"8fd5733f-0623-4401-b880-46957dca3a4a\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") "
Oct 30 14:26:01.654867 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654775    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home\") pod \"8fd5733f-0623-4401-b880-46957dca3a4a\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") "
Oct 30 14:26:01.654867 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654815    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir\") pod \"8fd5733f-0623-4401-b880-46957dca3a4a\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") "
Oct 30 14:26:01.654867 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654848    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home\") pod \"20f273f4-027a-43a0-9347-f065adbec5de\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") "
Oct 30 14:26:01.655022 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654923    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs\") pod \"8fd5733f-0623-4401-b880-46957dca3a4a\" (UID: \"8fd5733f-0623-4401-b880-46957dca3a4a\") "
Oct 30 14:26:01.655022 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.654993    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs\" (UniqueName: \"kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs\") pod \"20f273f4-027a-43a0-9347-f065adbec5de\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") "
Oct 30 14:26:01.655131 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655049    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm\") pod \"20f273f4-027a-43a0-9347-f065adbec5de\" (UID: \"20f273f4-027a-43a0-9347-f065adbec5de\") "
Oct 30 14:26:01.655131 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655095    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm\") pod \"45e08735-ec07-4a61-aef4-0703e558413f\" (UID: \"45e08735-ec07-4a61-aef4-0703e558413f\") "
Oct 30 14:26:01.655312 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655288    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home" pod "8fd5733f-0623-4401-b880-46957dca3a4a" (UID: "8fd5733f-0623-4401-b880-46957dca3a4a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.655613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655582    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir" pod "20f273f4-027a-43a0-9347-f065adbec5de" (UID: "20f273f4-027a-43a0-9347-f065adbec5de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.655821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655794    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache" pod "8fd5733f-0623-4401-b880-46957dca3a4a" (UID: "8fd5733f-0623-4401-b880-46957dca3a4a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.655821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655816    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.655960 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655836    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.655960 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655849    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.655960 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655861    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.655960 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.655875    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.656166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.656089    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache" pod "45e08735-ec07-4a61-aef4-0703e558413f" (UID: "45e08735-ec07-4a61-aef4-0703e558413f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.658674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.657209    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb" pod "8fd5733f-0623-4401-b880-46957dca3a4a" (UID: "8fd5733f-0623-4401-b880-46957dca3a4a"). InnerVolumeSpecName "kube-api-access-d4dlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:01.658674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.658463    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir" pod "8fd5733f-0623-4401-b880-46957dca3a4a" (UID: "8fd5733f-0623-4401-b880-46957dca3a4a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.658674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.658646    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home" pod "20f273f4-027a-43a0-9347-f065adbec5de" (UID: "20f273f4-027a-43a0-9347-f065adbec5de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.659145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.659118    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs" pod "20f273f4-027a-43a0-9347-f065adbec5de" (UID: "20f273f4-027a-43a0-9347-f065adbec5de"). InnerVolumeSpecName "kube-api-access-h9pfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:01.660522 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.660493    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm" pod "45e08735-ec07-4a61-aef4-0703e558413f" (UID: "45e08735-ec07-4a61-aef4-0703e558413f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.661579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.661550    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs" pod "20f273f4-027a-43a0-9347-f065adbec5de" (UID: "20f273f4-027a-43a0-9347-f065adbec5de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:01.661674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.661576    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm" pod "8fd5733f-0623-4401-b880-46957dca3a4a" (UID: "8fd5733f-0623-4401-b880-46957dca3a4a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.661674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.661631    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs" pod "45e08735-ec07-4a61-aef4-0703e558413f" (UID: "45e08735-ec07-4a61-aef4-0703e558413f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:01.661674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.661654    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz" pod "45e08735-ec07-4a61-aef4-0703e558413f" (UID: "45e08735-ec07-4a61-aef4-0703e558413f"). InnerVolumeSpecName "kube-api-access-m2jvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:01.663230 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.663201    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs" pod "8fd5733f-0623-4401-b880-46957dca3a4a" (UID: "8fd5733f-0623-4401-b880-46957dca3a4a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:01.664101 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.664076    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm" pod "20f273f4-027a-43a0-9347-f065adbec5de" (UID: "20f273f4-027a-43a0-9347-f065adbec5de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:01.757475 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757445    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757475 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757475    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4dlb\" (UniqueName: \"kubernetes.io/projected/8fd5733f-0623-4401-b880-46957dca3a4a-kube-api-access-d4dlb\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757490    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9pfs\" (UniqueName: \"kubernetes.io/projected/20f273f4-027a-43a0-9347-f065adbec5de-kube-api-access-h9pfs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757503    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2jvz\" (UniqueName: \"kubernetes.io/projected/45e08735-ec07-4a61-aef4-0703e558413f-kube-api-access-m2jvz\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757515    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e08735-ec07-4a61-aef4-0703e558413f-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757526    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e08735-ec07-4a61-aef4-0703e558413f-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757537    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757547    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757557    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd5733f-0623-4401-b880-46957dca3a4a-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757567    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757579    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fd5733f-0623-4401-b880-46957dca3a4a-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757590    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f273f4-027a-43a0-9347-f065adbec5de-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:01.757681 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:01.757600    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f273f4-027a-43a0-9347-f065adbec5de-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:02.003390 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.003353    4538 generic.go:356] "Generic (PLEG): container finished" podID="8fd5733f-0623-4401-b880-46957dca3a4a" containerID="2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15" exitCode=0
Oct 30 14:26:02.004046 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.003407    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"
Oct 30 14:26:02.004209 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.003431    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" event={"ID":"8fd5733f-0623-4401-b880-46957dca3a4a","Type":"ContainerDied","Data":"2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15"}
Oct 30 14:26:02.004313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.004293    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk" event={"ID":"8fd5733f-0623-4401-b880-46957dca3a4a","Type":"ContainerDied","Data":"21c50d57909a4046cb02d1f5e0a7cded6a54deb228d1641510c90a2e6df328fa"}
Oct 30 14:26:02.004393 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.004331    4538 scope.go:122] "RemoveContainer" containerID="2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15"
Oct 30 14:26:02.011181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.010857    4538 generic.go:356] "Generic (PLEG): container finished" podID="45e08735-ec07-4a61-aef4-0703e558413f" containerID="3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd" exitCode=0
Oct 30 14:26:02.011181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.011053    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" event={"ID":"45e08735-ec07-4a61-aef4-0703e558413f","Type":"ContainerDied","Data":"3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd"}
Oct 30 14:26:02.011181 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.011089    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h" event={"ID":"45e08735-ec07-4a61-aef4-0703e558413f","Type":"ContainerDied","Data":"5321a20db0cc249ac27529464e3b76d02408bf1e0edfddbcd16adf38e2c8f909"}
Oct 30 14:26:02.011660 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.011640    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"
Oct 30 14:26:02.024319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.018350    4538 generic.go:356] "Generic (PLEG): container finished" podID="20f273f4-027a-43a0-9347-f065adbec5de" containerID="1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438" exitCode=0
Oct 30 14:26:02.024319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.018599    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"
Oct 30 14:26:02.024884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.024859    4538 scope.go:122] "RemoveContainer" containerID="2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15"
Oct 30 14:26:02.025076 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.024977    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" event={"ID":"20f273f4-027a-43a0-9347-f065adbec5de","Type":"ContainerDied","Data":"1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438"}
Oct 30 14:26:02.025155 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.025111    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx" event={"ID":"20f273f4-027a-43a0-9347-f065adbec5de","Type":"ContainerDied","Data":"421427e6044ec194b31cf8aff1d184d01e7158d425688f92e09738ee157cd676"}
Oct 30 14:26:02.028862 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:02.028838    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15\": container with ID starting with 2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15 not found: ID does not exist" containerID="2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15"
Oct 30 14:26:02.028964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.028871    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15"} err="failed to get container status \"2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15\": rpc error: code = NotFound desc = could not find container \"2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15\": container with ID starting with 2eaf31ef1c8a12d8544dc910426489ec103f8fbf616f2a878282c1bd8de25f15 not found: ID does not exist"
Oct 30 14:26:02.028964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.028895    4538 scope.go:122] "RemoveContainer" containerID="3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd"
Oct 30 14:26:02.040990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.040970    4538 scope.go:122] "RemoveContainer" containerID="3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd"
Oct 30 14:26:02.041287 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:02.041234    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd\": container with ID starting with 3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd not found: ID does not exist" containerID="3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd"
Oct 30 14:26:02.041346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.041300    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd"} err="failed to get container status \"3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd\": rpc error: code = NotFound desc = could not find container \"3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd\": container with ID starting with 3156e16dc0f4a1853ca3da1926083382a205ef888bf64f5f1d3501ddd09d4ccd not found: ID does not exist"
Oct 30 14:26:02.041346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.041320    4538 scope.go:122] "RemoveContainer" containerID="1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438"
Oct 30 14:26:02.051673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.051596    4538 scope.go:122] "RemoveContainer" containerID="1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438"
Oct 30 14:26:02.051873 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:02.051854    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438\": container with ID starting with 1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438 not found: ID does not exist" containerID="1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438"
Oct 30 14:26:02.051927 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.051883    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438"} err="failed to get container status \"1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438\": rpc error: code = NotFound desc = could not find container \"1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438\": container with ID starting with 1b2159ac4f0679019bdd40b8d2b34ad750572929c19a592cc3dd995c50407438 not found: ID does not exist"
Oct 30 14:26:02.084697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.084670    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"]
Oct 30 14:26:02.087809 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.087786    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/premium-w0-1d36cf-kserve-69bcfb5b6f-s6npk"]
Oct 30 14:26:02.145805 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.145778    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"]
Oct 30 14:26:02.150580 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.150556    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-w0-1d36cf-kserve-64ff4d6c84-69pzx"]
Oct 30 14:26:02.154274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.154241    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:26:02.185960 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.185939    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"]
Oct 30 14:26:02.193083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.193061    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/simulator-w0-1d36cf-kserve-59d9b5df88-p649h"]
Oct 30 14:26:02.263588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.263486    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca\") pod \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") "
Oct 30 14:26:02.263588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.263574    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp\" (UniqueName: \"kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp\") pod \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") "
Oct 30 14:26:02.263769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.263674    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca\") pod \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\" (UID: \"db69ea2b-8e84-4aa5-b523-dc69b18fa006\") "
Oct 30 14:26:02.263933 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.263905    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca" pod "db69ea2b-8e84-4aa5-b523-dc69b18fa006" (UID: "db69ea2b-8e84-4aa5-b523-dc69b18fa006"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:02.264354 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.264328    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:02.266177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.266150    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca" pod "db69ea2b-8e84-4aa5-b523-dc69b18fa006" (UID: "db69ea2b-8e84-4aa5-b523-dc69b18fa006"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:02.266357 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.266340    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp" pod "db69ea2b-8e84-4aa5-b523-dc69b18fa006" (UID: "db69ea2b-8e84-4aa5-b523-dc69b18fa006"). InnerVolumeSpecName "kube-api-access-nhkrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:02.365908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.365836    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhkrp\" (UniqueName: \"kubernetes.io/projected/db69ea2b-8e84-4aa5-b523-dc69b18fa006-kube-api-access-nhkrp\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:02.365908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.365865    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db69ea2b-8e84-4aa5-b523-dc69b18fa006-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:02.583216 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.583190    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20f273f4-027a-43a0-9347-f065adbec5de" path="/var/lib/kubelet/pods/20f273f4-027a-43a0-9347-f065adbec5de/volumes"
Oct 30 14:26:02.583650 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.583635    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45e08735-ec07-4a61-aef4-0703e558413f" path="/var/lib/kubelet/pods/45e08735-ec07-4a61-aef4-0703e558413f/volumes"
Oct 30 14:26:02.584017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:02.584002    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" path="/var/lib/kubelet/pods/8fd5733f-0623-4401-b880-46957dca3a4a/volumes"
Oct 30 14:26:03.031108 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:03.031013    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f" event={"ID":"db69ea2b-8e84-4aa5-b523-dc69b18fa006","Type":"ContainerDied","Data":"f6f115e8b8f11e714741a6b25f0c56369f97a869bfa9e2de8a8a869a4592d4b0"}
Oct 30 14:26:03.031108 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:03.031080    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6f115e8b8f11e714741a6b25f0c56369f97a869bfa9e2de8a8a869a4592d4b0"
Oct 30 14:26:03.031776 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:03.031153    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"
Oct 30 14:26:04.142256 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.142201    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"]
Oct 30 14:26:04.143073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143043    4538 cpu_manager.go:414] "containerMap: removing container" podUID="db69ea2b-8e84-4aa5-b523-dc69b18fa006" containerName="revoke-keys"
Oct 30 14:26:04.143073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143068    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db69ea2b-8e84-4aa5-b523-dc69b18fa006" containerName="revoke-keys"
Oct 30 14:26:04.143228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143090    4538 cpu_manager.go:414] "containerMap: removing container" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main"
Oct 30 14:26:04.143228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143097    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main"
Oct 30 14:26:04.143228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143108    4538 cpu_manager.go:414] "containerMap: removing container" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main"
Oct 30 14:26:04.143228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143116    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main"
Oct 30 14:26:04.143228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143160    4538 cpu_manager.go:414] "containerMap: removing container" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main"
Oct 30 14:26:04.143228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143168    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main"
Oct 30 14:26:04.143578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143313    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fd5733f-0623-4401-b880-46957dca3a4a" containerName="main"
Oct 30 14:26:04.143578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143332    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="db69ea2b-8e84-4aa5-b523-dc69b18fa006" containerName="revoke-keys"
Oct 30 14:26:04.143578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143343    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="45e08735-ec07-4a61-aef4-0703e558413f" containerName="main"
Oct 30 14:26:04.143578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.143354    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="20f273f4-027a-43a0-9347-f065adbec5de" containerName="main"
Oct 30 14:26:04.147051 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.147030    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.182190 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.181448    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:26:04.182190 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.182014    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:26:04.206319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.206043    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.206319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.206137    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.206319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.206261    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg4c9\" (UniqueName: \"kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.214998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.214972    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"]
Oct 30 14:26:04.307076 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.307040    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.307274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.307121    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg4c9\" (UniqueName: \"kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.307274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.307204    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.307839 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.307812    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.309508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.309489    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.332030 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.332006    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg4c9\" (UniqueName: \"kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9\") pod \"maas-api-revoke-sub-b0e6b7a2-vj8kl\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.513857 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.513786    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:04.825836 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.825802    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"]
Oct 30 14:26:04.965275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:04.965239    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:26:05.013995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.013933    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.014166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014070    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.014166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014114    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.014166 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014160    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.015621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014197    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.015621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014226    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.015621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014284    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.015621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014402    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.015621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.014489    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert\") pod \"57d530c1-005d-4542-975a-67c649280d31\" (UID: \"57d530c1-005d-4542-975a-67c649280d31\") "
Oct 30 14:26:05.019505 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.015696    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:05.019575 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.019508    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "kube-api-access-4wf6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:05.019744 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.019723    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.019906 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.019888    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.020673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.020648    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.021849 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.021819    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.023126 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.023098    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:05.024365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.024339    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.025689 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.025653    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token" pod "57d530c1-005d-4542-975a-67c649280d31" (UID: "57d530c1-005d-4542-975a-67c649280d31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:05.058084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.058064    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:26:05.073645 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.073593    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl" event={"ID":"41a10681-13c3-49d3-9902-b23a1f1f882b","Type":"ContainerStarted","Data":"dd5bf2e249315543d6138dea1fde13d20c4d6a970c6cf5da862258a39c785050"}
Oct 30 14:26:05.074862 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.074845    4538 generic.go:356] "Generic (PLEG): container finished" podID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerID="a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc" exitCode=0
Oct 30 14:26:05.074936 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.074889    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"
Oct 30 14:26:05.074985 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.074928    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" event={"ID":"de7ef1b4-54e9-4a73-a912-62e6f5886c88","Type":"ContainerDied","Data":"a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc"}
Oct 30 14:26:05.074985 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.074964    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7" event={"ID":"de7ef1b4-54e9-4a73-a912-62e6f5886c88","Type":"ContainerDied","Data":"74d60694d43dc20960108a20d9421feacf7165cdd74a076971945b99407d2fd5"}
Oct 30 14:26:05.075057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.074990    4538 scope.go:122] "RemoveContainer" containerID="a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc"
Oct 30 14:26:05.076209 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.076191    4538 generic.go:356] "Generic (PLEG): container finished" podID="57d530c1-005d-4542-975a-67c649280d31" containerID="77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08" exitCode=0
Oct 30 14:26:05.076280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.076230    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" event={"ID":"57d530c1-005d-4542-975a-67c649280d31","Type":"ContainerDied","Data":"77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08"}
Oct 30 14:26:05.076280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.076236    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"
Oct 30 14:26:05.076280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.076275    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp" event={"ID":"57d530c1-005d-4542-975a-67c649280d31","Type":"ContainerDied","Data":"88bcf4fe8d255fc05059cfc1199d05dfaed5d3b4f80c9ab7c4faf208e4f39a78"}
Oct 30 14:26:05.084589 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.084572    4538 scope.go:122] "RemoveContainer" containerID="a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc"
Oct 30 14:26:05.084853 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:05.084837    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc\": container with ID starting with a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc not found: ID does not exist" containerID="a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc"
Oct 30 14:26:05.084906 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.084861    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc"} err="failed to get container status \"a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc\": rpc error: code = NotFound desc = could not find container \"a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc\": container with ID starting with a41b50c2422334fd64fd144d0cfc89be5023503d1cd8afcac0f1db334d4a38dc not found: ID does not exist"
Oct 30 14:26:05.084906 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.084876    4538 scope.go:122] "RemoveContainer" containerID="77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08"
Oct 30 14:26:05.093104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.093080    4538 scope.go:122] "RemoveContainer" containerID="77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08"
Oct 30 14:26:05.093352 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:05.093332    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08\": container with ID starting with 77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08 not found: ID does not exist" containerID="77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08"
Oct 30 14:26:05.093404 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.093357    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08"} err="failed to get container status \"77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08\": rpc error: code = NotFound desc = could not find container \"77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08\": container with ID starting with 77d9593fb62da52dff78443ae1e5f1a016bdde0d9bad9d93d583bec2881fee08 not found: ID does not exist"
Oct 30 14:26:05.116092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116065    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116209 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116140    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116283 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116205    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116283 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116271    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116355    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116355    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.116508 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116440    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116569 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116511    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116569 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116562    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116660 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116625    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket\") pod \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\" (UID: \"de7ef1b4-54e9-4a73-a912-62e6f5886c88\") "
Oct 30 14:26:05.116858 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116834    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.116858 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.116846    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:05.117057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117035    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.117226 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117208    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117232    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117262    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d530c1-005d-4542-975a-67c649280d31-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117304    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117315    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117327    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117325    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117339    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117352    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d530c1-005d-4542-975a-67c649280d31-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117365    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117377    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d530c1-005d-4542-975a-67c649280d31-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117389    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117401    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.117515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.117413    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wf6b\" (UniqueName: \"kubernetes.io/projected/57d530c1-005d-4542-975a-67c649280d31-kube-api-access-4wf6b\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.118967 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.118932    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:05.119464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.119436    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "kube-api-access-g8t8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:05.119589 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.119565    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:05.119871 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.119848    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo" pod "de7ef1b4-54e9-4a73-a912-62e6f5886c88" (UID: "de7ef1b4-54e9-4a73-a912-62e6f5886c88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:05.164889 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.164835    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"]
Oct 30 14:26:05.170038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.170009    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-lcjwp"]
Oct 30 14:26:05.218413 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.218377    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.218413 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.218407    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.218589 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.218420    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7ef1b4-54e9-4a73-a912-62e6f5886c88-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.218589 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.218448    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8t8q\" (UniqueName: \"kubernetes.io/projected/de7ef1b4-54e9-4a73-a912-62e6f5886c88-kube-api-access-g8t8q\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.218589 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.218463    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7ef1b4-54e9-4a73-a912-62e6f5886c88-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:05.425004 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.424978    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"]
Oct 30 14:26:05.429290 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:05.429265    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-l99s7"]
Oct 30 14:26:06.085269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.085208    4538 generic.go:356] "Generic (PLEG): container finished" podID="41a10681-13c3-49d3-9902-b23a1f1f882b" containerID="afe2e8fdcbdad48dbf18fb415c70386ef63e78d4cf5cda8893c0ccc3d493e763" exitCode=0
Oct 30 14:26:06.085452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.085289    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl" event={"ID":"41a10681-13c3-49d3-9902-b23a1f1f882b","Type":"ContainerDied","Data":"afe2e8fdcbdad48dbf18fb415c70386ef63e78d4cf5cda8893c0ccc3d493e763"}
Oct 30 14:26:06.102910 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.102876    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerName="payload-pre-processing" containerID="cri-o://1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f" gracePeriod=25
Oct 30 14:26:06.583566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.583521    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57d530c1-005d-4542-975a-67c649280d31" path="/var/lib/kubelet/pods/57d530c1-005d-4542-975a-67c649280d31/volumes"
Oct 30 14:26:06.584034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.584018    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" path="/var/lib/kubelet/pods/de7ef1b4-54e9-4a73-a912-62e6f5886c88/volumes"
Oct 30 14:26:06.895884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.895796    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:26:06.895884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:06.895872    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:26:07.228024 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.227998    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:07.241680 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.241656    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca\") pod \"41a10681-13c3-49d3-9902-b23a1f1f882b\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") "
Oct 30 14:26:07.241808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.241705    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca\") pod \"41a10681-13c3-49d3-9902-b23a1f1f882b\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") "
Oct 30 14:26:07.241808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.241794    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9\" (UniqueName: \"kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9\") pod \"41a10681-13c3-49d3-9902-b23a1f1f882b\" (UID: \"41a10681-13c3-49d3-9902-b23a1f1f882b\") "
Oct 30 14:26:07.241984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.241962    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca" pod "41a10681-13c3-49d3-9902-b23a1f1f882b" (UID: "41a10681-13c3-49d3-9902-b23a1f1f882b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:07.242182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.242165    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:07.243796 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.243769    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca" pod "41a10681-13c3-49d3-9902-b23a1f1f882b" (UID: "41a10681-13c3-49d3-9902-b23a1f1f882b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:07.243885 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.243847    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9" pod "41a10681-13c3-49d3-9902-b23a1f1f882b" (UID: "41a10681-13c3-49d3-9902-b23a1f1f882b"). InnerVolumeSpecName "kube-api-access-rg4c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:07.343790 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.343756    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg4c9\" (UniqueName: \"kubernetes.io/projected/41a10681-13c3-49d3-9902-b23a1f1f882b-kube-api-access-rg4c9\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:07.343790 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:07.343785    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/41a10681-13c3-49d3-9902-b23a1f1f882b-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:08.106219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:08.106187    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"
Oct 30 14:26:08.106676 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:08.106218    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl" event={"ID":"41a10681-13c3-49d3-9902-b23a1f1f882b","Type":"ContainerDied","Data":"dd5bf2e249315543d6138dea1fde13d20c4d6a970c6cf5da862258a39c785050"}
Oct 30 14:26:08.106676 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:08.106329    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd5bf2e249315543d6138dea1fde13d20c4d6a970c6cf5da862258a39c785050"
Oct 30 14:26:10.424516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.424475    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main" containerID="cri-o://af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930" gracePeriod=45
Oct 30 14:26:10.437764 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.437718    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main" containerID="cri-o://101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593" gracePeriod=45
Oct 30 14:26:10.715104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.715082    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:26:10.718352 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.718332    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:26:10.781172 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781142    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth\" (UniqueName: \"kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth\") pod \"da3c235b-eb75-489b-90fc-1c1d9475e207\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") "
Oct 30 14:26:10.781375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781185    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir\") pod \"da3c235b-eb75-489b-90fc-1c1d9475e207\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") "
Oct 30 14:26:10.781375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781286    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm\") pod \"d37a3272-56f2-42c3-8b86-d81af0762ebc\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") "
Oct 30 14:26:10.781375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781321    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache\") pod \"da3c235b-eb75-489b-90fc-1c1d9475e207\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") "
Oct 30 14:26:10.781375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781359    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm\") pod \"da3c235b-eb75-489b-90fc-1c1d9475e207\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") "
Oct 30 14:26:10.781605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781395    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk\" (UniqueName: \"kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk\") pod \"d37a3272-56f2-42c3-8b86-d81af0762ebc\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") "
Oct 30 14:26:10.781605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781471    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home\") pod \"d37a3272-56f2-42c3-8b86-d81af0762ebc\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") "
Oct 30 14:26:10.781605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781538    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir\") pod \"d37a3272-56f2-42c3-8b86-d81af0762ebc\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") "
Oct 30 14:26:10.781605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781576    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs\" (UniqueName: \"kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs\") pod \"d37a3272-56f2-42c3-8b86-d81af0762ebc\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") "
Oct 30 14:26:10.781802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781629    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir" pod "da3c235b-eb75-489b-90fc-1c1d9475e207" (UID: "da3c235b-eb75-489b-90fc-1c1d9475e207"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.781802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781717    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home\") pod \"da3c235b-eb75-489b-90fc-1c1d9475e207\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") "
Oct 30 14:26:10.781802 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781763    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs\") pod \"da3c235b-eb75-489b-90fc-1c1d9475e207\" (UID: \"da3c235b-eb75-489b-90fc-1c1d9475e207\") "
Oct 30 14:26:10.781942 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.781830    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache\") pod \"d37a3272-56f2-42c3-8b86-d81af0762ebc\" (UID: \"d37a3272-56f2-42c3-8b86-d81af0762ebc\") "
Oct 30 14:26:10.782231 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782200    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache" pod "da3c235b-eb75-489b-90fc-1c1d9475e207" (UID: "da3c235b-eb75-489b-90fc-1c1d9475e207"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.782758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782417    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir" pod "d37a3272-56f2-42c3-8b86-d81af0762ebc" (UID: "d37a3272-56f2-42c3-8b86-d81af0762ebc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.782758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782425    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache" pod "d37a3272-56f2-42c3-8b86-d81af0762ebc" (UID: "d37a3272-56f2-42c3-8b86-d81af0762ebc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.782758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782476    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.782758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782503    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.782758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782584    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home" pod "d37a3272-56f2-42c3-8b86-d81af0762ebc" (UID: "d37a3272-56f2-42c3-8b86-d81af0762ebc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.782758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.782593    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home" pod "da3c235b-eb75-489b-90fc-1c1d9475e207" (UID: "da3c235b-eb75-489b-90fc-1c1d9475e207"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.784107 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.784086    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth" pod "da3c235b-eb75-489b-90fc-1c1d9475e207" (UID: "da3c235b-eb75-489b-90fc-1c1d9475e207"). InnerVolumeSpecName "kube-api-access-t8pth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:10.785650 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.785571    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm" pod "da3c235b-eb75-489b-90fc-1c1d9475e207" (UID: "da3c235b-eb75-489b-90fc-1c1d9475e207"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.785650 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.785604    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk" pod "d37a3272-56f2-42c3-8b86-d81af0762ebc" (UID: "d37a3272-56f2-42c3-8b86-d81af0762ebc"). InnerVolumeSpecName "kube-api-access-bzglk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:10.785778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.785691    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs" pod "da3c235b-eb75-489b-90fc-1c1d9475e207" (UID: "da3c235b-eb75-489b-90fc-1c1d9475e207"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:10.785852 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.785833    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm" pod "d37a3272-56f2-42c3-8b86-d81af0762ebc" (UID: "d37a3272-56f2-42c3-8b86-d81af0762ebc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:10.786769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.786746    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs" pod "d37a3272-56f2-42c3-8b86-d81af0762ebc" (UID: "d37a3272-56f2-42c3-8b86-d81af0762ebc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:26:10.884160 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884132    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884160 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884160    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3c235b-eb75-489b-90fc-1c1d9475e207-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884171    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884180    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8pth\" (UniqueName: \"kubernetes.io/projected/da3c235b-eb75-489b-90fc-1c1d9475e207-kube-api-access-t8pth\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884189    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884197    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3c235b-eb75-489b-90fc-1c1d9475e207-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884205    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzglk\" (UniqueName: \"kubernetes.io/projected/d37a3272-56f2-42c3-8b86-d81af0762ebc-kube-api-access-bzglk\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884212    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884222    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37a3272-56f2-42c3-8b86-d81af0762ebc-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:10.884346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:10.884229    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37a3272-56f2-42c3-8b86-d81af0762ebc-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:11.126506 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.126477    4538 generic.go:356] "Generic (PLEG): container finished" podID="3d1da9a0-5caa-492e-8582-1514ae933085" containerID="b347cb3984fe65060b39c743dddedb2b10b1ff63281c285e02741565da08a0a2" exitCode=0
Oct 30 14:26:11.126634 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.126611    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" event={"ID":"3d1da9a0-5caa-492e-8582-1514ae933085","Type":"ContainerDied","Data":"b347cb3984fe65060b39c743dddedb2b10b1ff63281c285e02741565da08a0a2"}
Oct 30 14:26:11.128300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.128273    4538 generic.go:356] "Generic (PLEG): container finished" podID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerID="af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930" exitCode=0
Oct 30 14:26:11.128438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.128342    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"
Oct 30 14:26:11.128438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.128359    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" event={"ID":"d37a3272-56f2-42c3-8b86-d81af0762ebc","Type":"ContainerDied","Data":"af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930"}
Oct 30 14:26:11.128438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.128398    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn" event={"ID":"d37a3272-56f2-42c3-8b86-d81af0762ebc","Type":"ContainerDied","Data":"8601e6991e56b840409db989d2881b2e0491852bc755a91e845d317a2a292438"}
Oct 30 14:26:11.128438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.128421    4538 scope.go:122] "RemoveContainer" containerID="af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930"
Oct 30 14:26:11.130303 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.130239    4538 generic.go:356] "Generic (PLEG): container finished" podID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerID="101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593" exitCode=0
Oct 30 14:26:11.130429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.130379    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" event={"ID":"da3c235b-eb75-489b-90fc-1c1d9475e207","Type":"ContainerDied","Data":"101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593"}
Oct 30 14:26:11.130429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.130409    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh" event={"ID":"da3c235b-eb75-489b-90fc-1c1d9475e207","Type":"ContainerDied","Data":"5a356d3edc0e79a3db798f102b7ff665b47540b45dc4d9a65adffd078a714e2b"}
Oct 30 14:26:11.130529 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.130473    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"
Oct 30 14:26:11.139415 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.139393    4538 scope.go:122] "RemoveContainer" containerID="af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930"
Oct 30 14:26:11.139685 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:11.139666    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930\": container with ID starting with af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930 not found: ID does not exist" containerID="af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930"
Oct 30 14:26:11.139768 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.139693    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930"} err="failed to get container status \"af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930\": rpc error: code = NotFound desc = could not find container \"af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930\": container with ID starting with af9df28dc3a9cc8f462856a7aa3f74693439eaf57e5c80b58806195ac9a96930 not found: ID does not exist"
Oct 30 14:26:11.139768 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.139709    4538 scope.go:122] "RemoveContainer" containerID="101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593"
Oct 30 14:26:11.140227 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.140203    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:26:11.150490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.150469    4538 scope.go:122] "RemoveContainer" containerID="101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593"
Oct 30 14:26:11.150789 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:11.150767    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593\": container with ID starting with 101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593 not found: ID does not exist" containerID="101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593"
Oct 30 14:26:11.150877 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.150793    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593"} err="failed to get container status \"101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593\": rpc error: code = NotFound desc = could not find container \"101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593\": container with ID starting with 101709f903b6d7975f6c1f37928366c463dab2386bc9ca197c19a11e89744593 not found: ID does not exist"
Oct 30 14:26:11.183641 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.183615    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"]
Oct 30 14:26:11.187951 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.187928    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d\" (UniqueName: \"kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d\") pod \"3d1da9a0-5caa-492e-8582-1514ae933085\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") "
Oct 30 14:26:11.188048 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.187977    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume\") pod \"3d1da9a0-5caa-492e-8582-1514ae933085\" (UID: \"3d1da9a0-5caa-492e-8582-1514ae933085\") "
Oct 30 14:26:11.188714 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.188685    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume" pod "3d1da9a0-5caa-492e-8582-1514ae933085" (UID: "3d1da9a0-5caa-492e-8582-1514ae933085"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:11.190998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.190971    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d" pod "3d1da9a0-5caa-492e-8582-1514ae933085" (UID: "3d1da9a0-5caa-492e-8582-1514ae933085"). InnerVolumeSpecName "kube-api-access-fgl9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:11.192690 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.192663    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/premium-w6-bf8266-kserve-7975c45658-q7fzn"]
Oct 30 14:26:11.235418 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.235326    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"]
Oct 30 14:26:11.239452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.239417    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-bf8266/simulator-w6-bf8266-kserve-578fbb775-shgxh"]
Oct 30 14:26:11.296265 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.293119    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgl9d\" (UniqueName: \"kubernetes.io/projected/3d1da9a0-5caa-492e-8582-1514ae933085-kube-api-access-fgl9d\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:11.296265 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:11.293156    4538 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1da9a0-5caa-492e-8582-1514ae933085-plugins-config-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:12.138942 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.138909    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l" event={"ID":"3d1da9a0-5caa-492e-8582-1514ae933085","Type":"ContainerDied","Data":"3aec025dc0f4f084f10fe3446584d147cdf3b4dfa5791ef278738bc202defcae"}
Oct 30 14:26:12.138942 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.138936    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"
Oct 30 14:26:12.139440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.138967    4538 scope.go:122] "RemoveContainer" containerID="b347cb3984fe65060b39c743dddedb2b10b1ff63281c285e02741565da08a0a2"
Oct 30 14:26:12.194877 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.194855    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"]
Oct 30 14:26:12.206951 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.206928    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-24dfd7-685c76bc9-lwj5l"]
Oct 30 14:26:12.582566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.582541    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" path="/var/lib/kubelet/pods/3d1da9a0-5caa-492e-8582-1514ae933085/volumes"
Oct 30 14:26:12.583000 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.582987    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" path="/var/lib/kubelet/pods/d37a3272-56f2-42c3-8b86-d81af0762ebc/volumes"
Oct 30 14:26:12.583401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:12.583389    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" path="/var/lib/kubelet/pods/da3c235b-eb75-489b-90fc-1c1d9475e207/volumes"
Oct 30 14:26:16.895639 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:16.895605    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:26:17.235036 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.234954    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"]
Oct 30 14:26:17.235601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235581    4538 cpu_manager.go:414] "containerMap: removing container" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235601    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235616    4538 cpu_manager.go:414] "containerMap: removing container" podUID="41a10681-13c3-49d3-9902-b23a1f1f882b" containerName="revoke-keys"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235624    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41a10681-13c3-49d3-9902-b23a1f1f882b" containerName="revoke-keys"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235636    4538 cpu_manager.go:414] "containerMap: removing container" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235644    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235653    4538 cpu_manager.go:414] "containerMap: removing container" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" containerName="payload-pre-processing"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235660    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" containerName="payload-pre-processing"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235685    4538 cpu_manager.go:414] "containerMap: removing container" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235693    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235712    4538 cpu_manager.go:414] "containerMap: removing container" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main"
Oct 30 14:26:17.235719 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235719    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main"
Oct 30 14:26:17.236241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235844    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="de7ef1b4-54e9-4a73-a912-62e6f5886c88" containerName="istio-proxy"
Oct 30 14:26:17.236241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235858    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="d37a3272-56f2-42c3-8b86-d81af0762ebc" containerName="main"
Oct 30 14:26:17.236241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235873    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="57d530c1-005d-4542-975a-67c649280d31" containerName="istio-proxy"
Oct 30 14:26:17.236241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235883    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="41a10681-13c3-49d3-9902-b23a1f1f882b" containerName="revoke-keys"
Oct 30 14:26:17.236241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235895    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="da3c235b-eb75-489b-90fc-1c1d9475e207" containerName="main"
Oct 30 14:26:17.236241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.235904    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d1da9a0-5caa-492e-8582-1514ae933085" containerName="payload-pre-processing"
Oct 30 14:26:17.243100 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.243066    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.266982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.266947    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"]
Oct 30 14:26:17.282566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.282541    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"]
Oct 30 14:26:17.286703 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.286682    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.316126 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.316104    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"]
Oct 30 14:26:17.382869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.382839    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.382869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.382872    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.382899    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383031    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383138 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383078    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn572\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383192 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383177    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlbbb\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383326 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383296    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383387 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383345    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383423 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383387    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383423 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383405    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383572 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383549    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383638 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383622    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383690 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383676    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383744    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383793 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383771    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383825 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383798    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.383871 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383856    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.383916 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.383883    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.485564 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485492    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlbbb\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.485564 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485546    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.485778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485568    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.485778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485624    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.485778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485648    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.485778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485694    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.485778 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485735    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485847    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485897    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485921    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485949    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.485980    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486007    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486052    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486080    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486126    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486131    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486150    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486155    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486366 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486229    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn572\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486695 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486380    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.486695 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486534    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486814 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486781    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486871 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486839    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.486927 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.486892    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.487352 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.487326    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.487352 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.487344    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.487697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.487676    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.488975 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.488947    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.489444 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.489418    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.489643 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.489619    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.489727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.489713    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.511405 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.511379    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.511702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.511679    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.512288 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.512263    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlbbb\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.512380 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.512303    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn572\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.559083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.559052    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:17.607310 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.607010    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:17.917370 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.917336    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"]
Oct 30 14:26:17.921206 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:26:17.921176    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dce1db_fd9e_4480_bfca_7b52d2228c19.slice/crio-ab2744c7b53e124e3633d46beea12ef194164ab0be05c025e3213c28c028e434 WatchSource:0}: Error finding container ab2744c7b53e124e3633d46beea12ef194164ab0be05c025e3213c28c028e434: Status 404 returned error can't find the container with id ab2744c7b53e124e3633d46beea12ef194164ab0be05c025e3213c28c028e434
Oct 30 14:26:17.924032 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.924001    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:17.924104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.924064    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:17.924104 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.924094    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:17.961306 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.961282    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"]
Oct 30 14:26:17.963875 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:26:17.963832    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbca2436_22ab_4cab_8e54_32499bd7b85f.slice/crio-032bd8e0579feebd03b133b5ca8d8425ea254ab6ba482859e9a0a827eafea712 WatchSource:0}: Error finding container 032bd8e0579feebd03b133b5ca8d8425ea254ab6ba482859e9a0a827eafea712: Status 404 returned error can't find the container with id 032bd8e0579feebd03b133b5ca8d8425ea254ab6ba482859e9a0a827eafea712
Oct 30 14:26:17.966395 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.966362    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:17.966496 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.966428    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:17.966496 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:17.966461    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:18.227349 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.227182    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" event={"ID":"67dce1db-fd9e-4480-bfca-7b52d2228c19","Type":"ContainerStarted","Data":"9c2713a58568769debbda3835a8190a8b401f06a9a202ac84b051cca7bf64acf"}
Oct 30 14:26:18.227349 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.227283    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" event={"ID":"67dce1db-fd9e-4480-bfca-7b52d2228c19","Type":"ContainerStarted","Data":"ab2744c7b53e124e3633d46beea12ef194164ab0be05c025e3213c28c028e434"}
Oct 30 14:26:18.236266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.231317    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" event={"ID":"dbca2436-22ab-4cab-8e54-32499bd7b85f","Type":"ContainerStarted","Data":"94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e"}
Oct 30 14:26:18.236266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.231404    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" event={"ID":"dbca2436-22ab-4cab-8e54-32499bd7b85f","Type":"ContainerStarted","Data":"032bd8e0579feebd03b133b5ca8d8425ea254ab6ba482859e9a0a827eafea712"}
Oct 30 14:26:18.294283 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.293111    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" podStartSLOduration=1.2930967469999999 podStartE2EDuration="1.293096747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:18.289568387 +0000 UTC m=+1171.924515007" watchObservedRunningTime="2026-10-30 14:26:18.293096747 +0000 UTC m=+1171.928043386"
Oct 30 14:26:18.340576 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.340501    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" podStartSLOduration=1.340480625 podStartE2EDuration="1.340480625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:18.338528058 +0000 UTC m=+1171.973474703" watchObservedRunningTime="2026-10-30 14:26:18.340480625 +0000 UTC m=+1171.975427245"
Oct 30 14:26:18.559820 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.559740    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:18.561453 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.561428    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 14:26:18.561517 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.561487    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 14:26:18.608277 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:18.608220    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:19.562124 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:19.561675    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 14:26:19.562124 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:19.561740    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 14:26:19.610139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:19.610105    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 14:26:19.610560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:19.610526    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 14:26:20.561270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:20.560669    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 14:26:20.561270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:20.560732    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 14:26:20.608410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:20.608373    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 14:26:20.608805 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:20.608423    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 14:26:21.476518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.431373    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"]
Oct 30 14:26:21.516272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.508415    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"]
Oct 30 14:26:21.516272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.508743    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" containerID="cri-o://3495c4c8c736dc8c35c5cc3245a05757880d126226d086d14ac2b044986dbc61" gracePeriod=30
Oct 30 14:26:21.516272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.509360    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" containerID="cri-o://1cd3d54127db2d660eb303c9162283dc1e0178162c9e1d4ae344db6aa0e2806a" gracePeriod=30
Oct 30 14:26:21.575384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.575351    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Oct 30 14:26:21.575654 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.575624    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Oct 30 14:26:21.608644 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.608615    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 14:26:21.609168 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.609141    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 14:26:21.660268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.659348    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"]
Oct 30 14:26:21.660268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:21.659615    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" containerID="cri-o://fff19bd7ed9ff8d30a8a050c7b057c690cf481c1bd60757a43425f7c4f40c4ab" gracePeriod=30
Oct 30 14:26:22.527271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.519326    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"]
Oct 30 14:26:22.542770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.542722    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy" containerID="cri-o://9c2713a58568769debbda3835a8190a8b401f06a9a202ac84b051cca7bf64acf" gracePeriod=30
Oct 30 14:26:22.638275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.626386    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Oct 30 14:26:22.638275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.626462    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Oct 30 14:26:22.776272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.772526    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"]
Oct 30 14:26:22.776272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.772747    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy" containerID="cri-o://94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e" gracePeriod=30
Oct 30 14:26:22.810319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.808150    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"]
Oct 30 14:26:22.810319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:22.808430    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" containerID="cri-o://7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a" gracePeriod=30
Oct 30 14:26:23.895669 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:23.895621    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 14:26:23.896152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:23.895728    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 14:26:24.423309 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:24.422389    4538 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 14:26:24.423309 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:24.422447    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 14:26:26.487906 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.487877    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:26:26.578878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.578846    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb\" (UniqueName: \"kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb\") pod \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") "
Oct 30 14:26:26.579094 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.579077    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume\") pod \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\" (UID: \"e2edd8c5-2b47-4af3-909a-883ae54f1f16\") "
Oct 30 14:26:26.580021 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.579998    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume" pod "e2edd8c5-2b47-4af3-909a-883ae54f1f16" (UID: "e2edd8c5-2b47-4af3-909a-883ae54f1f16"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:26.585157 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.584866    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 14:26:26.585157 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.584922    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 14:26:26.599798 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.599767    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb" pod "e2edd8c5-2b47-4af3-909a-883ae54f1f16" (UID: "e2edd8c5-2b47-4af3-909a-883ae54f1f16"). InnerVolumeSpecName "kube-api-access-b72bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:26.682293 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.681112    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b72bb\" (UniqueName: \"kubernetes.io/projected/e2edd8c5-2b47-4af3-909a-883ae54f1f16-kube-api-access-b72bb\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:26.682293 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.681147    4538 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2edd8c5-2b47-4af3-909a-883ae54f1f16-plugins-config-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:26.700560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.700185    4538 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Oct 30 14:26:26.700560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.700271    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Oct 30 14:26:26.783861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.783706    4538 generic.go:356] "Generic (PLEG): container finished" podID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerID="3495c4c8c736dc8c35c5cc3245a05757880d126226d086d14ac2b044986dbc61" exitCode=0
Oct 30 14:26:26.783861 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.783802    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" event={"ID":"63089898-49c0-4f68-a2e1-6b68425e1f76","Type":"ContainerDied","Data":"3495c4c8c736dc8c35c5cc3245a05757880d126226d086d14ac2b044986dbc61"}
Oct 30 14:26:26.789266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.785407    4538 generic.go:356] "Generic (PLEG): container finished" podID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerID="1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f" exitCode=0
Oct 30 14:26:26.789266 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.785557    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"
Oct 30 14:26:26.791943 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.791395    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" event={"ID":"e2edd8c5-2b47-4af3-909a-883ae54f1f16","Type":"ContainerDied","Data":"1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f"}
Oct 30 14:26:26.791943 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.791454    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6" event={"ID":"e2edd8c5-2b47-4af3-909a-883ae54f1f16","Type":"ContainerDied","Data":"dac66f428108b782448b1ba0e8ce43e7f28ff392f9639eaab78925cad3e5f618"}
Oct 30 14:26:26.791943 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.791483    4538 scope.go:122] "RemoveContainer" containerID="1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f"
Oct 30 14:26:26.823767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.822178    4538 generic.go:356] "Generic (PLEG): container finished" podID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerID="fff19bd7ed9ff8d30a8a050c7b057c690cf481c1bd60757a43425f7c4f40c4ab" exitCode=0
Oct 30 14:26:26.823767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.822290    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" event={"ID":"388adf68-7b3f-4e81-b770-c468f5720ddf","Type":"ContainerDied","Data":"fff19bd7ed9ff8d30a8a050c7b057c690cf481c1bd60757a43425f7c4f40c4ab"}
Oct 30 14:26:26.826329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.826265    4538 scope.go:122] "RemoveContainer" containerID="1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f"
Oct 30 14:26:26.826660 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:26.826623    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f\": container with ID starting with 1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f not found: ID does not exist" containerID="1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f"
Oct 30 14:26:26.826758 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.826668    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f"} err="failed to get container status \"1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f\": rpc error: code = NotFound desc = could not find container \"1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f\": container with ID starting with 1ac98132416da3f1f0abe02ac244fc99e2e5cbe4f842cc8b22a246596b41512f not found: ID does not exist"
Oct 30 14:26:26.829285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.827275    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" event={"ID":"c3091838-d266-4134-9f34-757353d9127c","Type":"ContainerDied","Data":"1cd3d54127db2d660eb303c9162283dc1e0178162c9e1d4ae344db6aa0e2806a"}
Oct 30 14:26:26.829403 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.826902    4538 generic.go:356] "Generic (PLEG): container finished" podID="c3091838-d266-4134-9f34-757353d9127c" containerID="1cd3d54127db2d660eb303c9162283dc1e0178162c9e1d4ae344db6aa0e2806a" exitCode=0
Oct 30 14:26:26.847286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.845942    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:26:26.856210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.856180    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"]
Oct 30 14:26:26.859568 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.859547    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-bf8266-6645f66899-84tn6"]
Oct 30 14:26:26.935612 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.935587    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:26:26.942293 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.942270    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:26:26.984949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.984851    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.985224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.985199    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.985392 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.985375    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.985507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.985493    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.985697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.985682    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.985832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.985817    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.985968 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.985944    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.986084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.986040    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.986084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.986074    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs\") pod \"63089898-49c0-4f68-a2e1-6b68425e1f76\" (UID: \"63089898-49c0-4f68-a2e1-6b68425e1f76\") "
Oct 30 14:26:26.986816 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.986789    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:26.987010 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.986990    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:26.987239 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.987216    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:26.987769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.987741    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:26.988013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.987990    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:26.989542 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.989515    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:26.989751 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.989719    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "kube-api-access-5b7sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:26.991655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.991622    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:26.993146 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:26.993124    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo" pod "63089898-49c0-4f68-a2e1-6b68425e1f76" (UID: "63089898-49c0-4f68-a2e1-6b68425e1f76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:27.086876 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.086839    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.086889    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.086932    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.086967    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087013    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087056    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087081    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087158    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087187    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087221    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087268    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087325    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087389    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087452    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087501    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087564    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket\") pod \"388adf68-7b3f-4e81-b770-c468f5720ddf\" (UID: \"388adf68-7b3f-4e81-b770-c468f5720ddf\") "
Oct 30 14:26:27.087631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087604    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.087946 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087642    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket\") pod \"c3091838-d266-4134-9f34-757353d9127c\" (UID: \"c3091838-d266-4134-9f34-757353d9127c\") "
Oct 30 14:26:27.088085 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087312    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.088210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088189    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b7sr\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-kube-api-access-5b7sr\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088316    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.088463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088406    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63089898-49c0-4f68-a2e1-6b68425e1f76-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088428    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088441    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088454    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088467    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088481    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088495    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088508    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088522    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63089898-49c0-4f68-a2e1-6b68425e1f76-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088505    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.088677 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.088672    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.089302 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.089205    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "kube-api-access-qxxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:27.089397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.089370    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.089784 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.089671    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:27.089871 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.089825    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.090001 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.089977    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "kube-api-access-wb8tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:27.090057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087487    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.090057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087694    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.090057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.087842    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.090162 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.090067    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:27.090162 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.090134    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:27.090949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.090928    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:27.091029 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.090961    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:27.091855 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.091839    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo" pod "c3091838-d266-4134-9f34-757353d9127c" (UID: "c3091838-d266-4134-9f34-757353d9127c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:27.092144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.092127    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo" pod "388adf68-7b3f-4e81-b770-c468f5720ddf" (UID: "388adf68-7b3f-4e81-b770-c468f5720ddf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:27.189303 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189279    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189303 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189301    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb8tb\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-kube-api-access-wb8tb\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189310    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189319    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189327    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3091838-d266-4134-9f34-757353d9127c-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189334    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189341    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388adf68-7b3f-4e81-b770-c468f5720ddf-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189349    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189356    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3091838-d266-4134-9f34-757353d9127c-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189363    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189370    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189377    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189385    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189393    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxxfk\" (UniqueName: \"kubernetes.io/projected/c3091838-d266-4134-9f34-757353d9127c-kube-api-access-qxxfk\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189404    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189416    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3091838-d266-4134-9f34-757353d9127c-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.189458 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.189427    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388adf68-7b3f-4e81-b770-c468f5720ddf-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:27.837836 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.837799    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4" event={"ID":"63089898-49c0-4f68-a2e1-6b68425e1f76","Type":"ContainerDied","Data":"17da115b30a831fce7f06dbbac703a3ec38d78e60eb56af324adb28854658eeb"}
Oct 30 14:26:27.838242 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.837874    4538 scope.go:122] "RemoveContainer" containerID="3495c4c8c736dc8c35c5cc3245a05757880d126226d086d14ac2b044986dbc61"
Oct 30 14:26:27.838242 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.837818    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"
Oct 30 14:26:27.840332 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.840306    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"
Oct 30 14:26:27.840422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.840304    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd" event={"ID":"388adf68-7b3f-4e81-b770-c468f5720ddf","Type":"ContainerDied","Data":"9543c668931af5587af79d579c5ffacbfbd383c08fdbfab9a9d0f53b93cd1d9b"}
Oct 30 14:26:27.841727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.841709    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"
Oct 30 14:26:27.841821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.841723    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk" event={"ID":"c3091838-d266-4134-9f34-757353d9127c","Type":"ContainerDied","Data":"0d907ec4cb775bc2e389b3e8bb831b22602a312c1910c25695a60cc98959ae9a"}
Oct 30 14:26:27.904649 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.904628    4538 scope.go:122] "RemoveContainer" containerID="fff19bd7ed9ff8d30a8a050c7b057c690cf481c1bd60757a43425f7c4f40c4ab"
Oct 30 14:26:27.930013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.928439    4538 scope.go:122] "RemoveContainer" containerID="1cd3d54127db2d660eb303c9162283dc1e0178162c9e1d4ae344db6aa0e2806a"
Oct 30 14:26:27.942305 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.942276    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"]
Oct 30 14:26:27.942576 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.942550    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy" containerID="cri-o://72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7" gracePeriod=30
Oct 30 14:26:27.951685 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.951655    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"]
Oct 30 14:26:27.951871 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.951850    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy" containerID="cri-o://dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560" gracePeriod=30
Oct 30 14:26:27.960648 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.960623    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"]
Oct 30 14:26:27.960883 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.960843    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy" containerID="cri-o://ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9" gracePeriod=30
Oct 30 14:26:27.967604 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.967563    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"]
Oct 30 14:26:27.974825 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:27.974783    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-l4wr4"]
Oct 30 14:26:28.016908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.016820    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"]
Oct 30 14:26:28.033741 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.033704    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-jc9pd"]
Oct 30 14:26:28.103084 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.103011    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"]
Oct 30 14:26:28.108479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.108442    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-lwhzk"]
Oct 30 14:26:28.127171 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.127147    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:26:28.203144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203115    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203333 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203173    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203333 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203265    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203456 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203349    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203456 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203391    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203590 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203554    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203659 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203629    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203714 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203555    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:28.203714 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203584    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:28.203714 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203682    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.203860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203741    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:28.203860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203741    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:28.203860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203742    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data\") pod \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\" (UID: \"16dd2bf3-1d2a-4529-bd63-60f181ec75b9\") "
Oct 30 14:26:28.204032 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.203918    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:28.204283 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.204260    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.204402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.204285    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.204402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.204300    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.204402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.204312    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.204402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.204324    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.205613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.205587    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:28.206285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.206232    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "kube-api-access-kv5jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:28.206443 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.206351    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:28.206795 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.206775    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token" pod "16dd2bf3-1d2a-4529-bd63-60f181ec75b9" (UID: "16dd2bf3-1d2a-4529-bd63-60f181ec75b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:28.305838 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.305789    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv5jc\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-kube-api-access-kv5jc\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.305838 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.305826    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.305838 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.305835    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.306060 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.305847    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16dd2bf3-1d2a-4529-bd63-60f181ec75b9-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:28.582513 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.582483    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" path="/var/lib/kubelet/pods/388adf68-7b3f-4e81-b770-c468f5720ddf/volumes"
Oct 30 14:26:28.583016 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.582996    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" path="/var/lib/kubelet/pods/63089898-49c0-4f68-a2e1-6b68425e1f76/volumes"
Oct 30 14:26:28.583514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.583485    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3091838-d266-4134-9f34-757353d9127c" path="/var/lib/kubelet/pods/c3091838-d266-4134-9f34-757353d9127c/volumes"
Oct 30 14:26:28.584232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.584212    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" path="/var/lib/kubelet/pods/e2edd8c5-2b47-4af3-909a-883ae54f1f16/volumes"
Oct 30 14:26:28.852984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.852886    4538 generic.go:356] "Generic (PLEG): container finished" podID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerID="7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a" exitCode=0
Oct 30 14:26:28.852984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.852943    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"
Oct 30 14:26:28.852984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.852965    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" event={"ID":"16dd2bf3-1d2a-4529-bd63-60f181ec75b9","Type":"ContainerDied","Data":"7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a"}
Oct 30 14:26:28.853608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.853018    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl" event={"ID":"16dd2bf3-1d2a-4529-bd63-60f181ec75b9","Type":"ContainerDied","Data":"0f412122375c0863d42c7dac2090dccc4680b96edf2cf46b53f439b2f5f10d06"}
Oct 30 14:26:28.853608 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.853043    4538 scope.go:122] "RemoveContainer" containerID="7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a"
Oct 30 14:26:28.863429 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.863413    4538 scope.go:122] "RemoveContainer" containerID="7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a"
Oct 30 14:26:28.863804 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:28.863784    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a\": container with ID starting with 7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a not found: ID does not exist" containerID="7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a"
Oct 30 14:26:28.863888 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.863812    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a"} err="failed to get container status \"7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a\": rpc error: code = NotFound desc = could not find container \"7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a\": container with ID starting with 7af5c096542967234c13aabd7551de73931ec82883d0d58fbf5bb1364b5fd39a not found: ID does not exist"
Oct 30 14:26:28.911394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.911360    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"]
Oct 30 14:26:28.923459 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:28.923432    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-r2wnl"]
Oct 30 14:26:30.583073 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:30.583042    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" path="/var/lib/kubelet/pods/16dd2bf3-1d2a-4529-bd63-60f181ec75b9/volumes"
Oct 30 14:26:31.626125 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:31.626083    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:26:31.878504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:31.878402    4538 generic.go:356] "Generic (PLEG): container finished" podID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerID="9c2713a58568769debbda3835a8190a8b401f06a9a202ac84b051cca7bf64acf" exitCode=0
Oct 30 14:26:31.878504 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:31.878476    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" event={"ID":"67dce1db-fd9e-4480-bfca-7b52d2228c19","Type":"ContainerDied","Data":"9c2713a58568769debbda3835a8190a8b401f06a9a202ac84b051cca7bf64acf"}
Oct 30 14:26:31.909059 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:31.909037    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:32.047622 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047579    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.047622 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047628    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.047878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047676    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.047878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047711    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.047878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047750    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.048007 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047902    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.048007 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.047977    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.048082 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048031    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.048115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048102    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.048178 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048128    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.048178 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048164    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.048268 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048238    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo\") pod \"67dce1db-fd9e-4480-bfca-7b52d2228c19\" (UID: \"67dce1db-fd9e-4480-bfca-7b52d2228c19\") "
Oct 30 14:26:32.048351 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048329    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.048552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048530    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:32.048721 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048701    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67dce1db-fd9e-4480-bfca-7b52d2228c19-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.048819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048726    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.048819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048741    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.048819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048754    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.048819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.048766    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.050704 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.050677    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:32.050814 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.050791    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.051031 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.051015    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:32.051227 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.051202    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb" pod "67dce1db-fd9e-4480-bfca-7b52d2228c19" (UID: "67dce1db-fd9e-4480-bfca-7b52d2228c19"). InnerVolumeSpecName "kube-api-access-xlbbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:32.143438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.143413    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:32.149625 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.149602    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.149735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.149627    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.149735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.149639    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67dce1db-fd9e-4480-bfca-7b52d2228c19-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.149735 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.149651    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlbbb\" (UniqueName: \"kubernetes.io/projected/67dce1db-fd9e-4480-bfca-7b52d2228c19-kube-api-access-xlbbb\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.250013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.249977    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250028    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250063    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250109    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250345 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250268    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250345 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250280    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.250410 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250396    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250451 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250438    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250462    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250511    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket\") pod \"dbca2436-22ab-4cab-8e54-32499bd7b85f\" (UID: \"dbca2436-22ab-4cab-8e54-32499bd7b85f\") "
Oct 30 14:26:32.250820 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.250808    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.253609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.253525    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.253609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.253542    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.253609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.253562    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.253807 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.253628    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:32.255514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.255474    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:32.255514 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.255504    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:32.255645 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.255581    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:32.255645 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.255602    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572" pod "dbca2436-22ab-4cab-8e54-32499bd7b85f" (UID: "dbca2436-22ab-4cab-8e54-32499bd7b85f"). InnerVolumeSpecName "kube-api-access-nn572". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:32.352210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352181    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352208    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352222    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352237    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352262    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352273    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbca2436-22ab-4cab-8e54-32499bd7b85f-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352282    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbca2436-22ab-4cab-8e54-32499bd7b85f-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.352422 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.352294    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn572\" (UniqueName: \"kubernetes.io/projected/dbca2436-22ab-4cab-8e54-32499bd7b85f-kube-api-access-nn572\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:32.886909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.886827    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"
Oct 30 14:26:32.886909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.886842    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24" event={"ID":"67dce1db-fd9e-4480-bfca-7b52d2228c19","Type":"ContainerDied","Data":"ab2744c7b53e124e3633d46beea12ef194164ab0be05c025e3213c28c028e434"}
Oct 30 14:26:32.887375 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.886914    4538 scope.go:122] "RemoveContainer" containerID="9c2713a58568769debbda3835a8190a8b401f06a9a202ac84b051cca7bf64acf"
Oct 30 14:26:32.888477 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.888450    4538 generic.go:356] "Generic (PLEG): container finished" podID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerID="94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e" exitCode=0
Oct 30 14:26:32.888587 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.888486    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"
Oct 30 14:26:32.888587 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.888534    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" event={"ID":"dbca2436-22ab-4cab-8e54-32499bd7b85f","Type":"ContainerDied","Data":"94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e"}
Oct 30 14:26:32.888692 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.888594    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp" event={"ID":"dbca2436-22ab-4cab-8e54-32499bd7b85f","Type":"ContainerDied","Data":"032bd8e0579feebd03b133b5ca8d8425ea254ab6ba482859e9a0a827eafea712"}
Oct 30 14:26:32.896606 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.896578    4538 scope.go:122] "RemoveContainer" containerID="94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e"
Oct 30 14:26:32.905290 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.905268    4538 scope.go:122] "RemoveContainer" containerID="94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e"
Oct 30 14:26:32.905560 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:32.905540    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e\": container with ID starting with 94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e not found: ID does not exist" containerID="94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e"
Oct 30 14:26:32.905637 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.905566    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e"} err="failed to get container status \"94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e\": rpc error: code = NotFound desc = could not find container \"94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e\": container with ID starting with 94781e9bd159566e245a2d1ef802eeab5c64eb2d34f236eff0698a23fd216a5e not found: ID does not exist"
Oct 30 14:26:32.955925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.955901    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"]
Oct 30 14:26:32.961630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:32.961607    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-9sgbp"]
Oct 30 14:26:33.010498 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.010467    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"]
Oct 30 14:26:33.017483 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.017457    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-bhn24"]
Oct 30 14:26:33.223058 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.223024    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:26:33.281580 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.281559    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:26:33.283937 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.283895    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:26:33.364531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364503    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364544    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364578    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364599    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364631    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364652    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364683    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364700    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.364739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364716    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364755    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364782    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364801    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364821    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364821    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364855    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364893    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364953    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.364994    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365023    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365051    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365051    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365078    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365110    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365150 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365138    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token\") pod \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\" (UID: \"9370c489-ee64-4ebe-a6cb-fa5349a7280b\") "
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365188    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365231    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365304    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data\") pod \"ad329dfc-08aa-4c5e-acbb-21fa74563261\" (UID: \"ad329dfc-08aa-4c5e-acbb-21fa74563261\") "
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365342    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365373    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket\") pod \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\" (UID: \"19ef9b3f-d7e1-4803-9ed7-0353861312b9\") "
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365719    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365809    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365829    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.365891 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365842    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.366425 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.365906    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.366425 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.366131    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.366425 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.366397    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.367880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.366816    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.367880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.367012    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.367880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.367308    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:33.367880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.367624    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.367880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.367827    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:33.368273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.368155    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:26:33.368440 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.368416    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.369441 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.369416    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.369761 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.369593    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.369862 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.369802    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.370320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.370286    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:33.370414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.370395    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "kube-api-access-2n6tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:33.372769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.372745    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:33.373471 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.373360    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:33.373471 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.373377    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:26:33.373471 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.373393    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "kube-api-access-xpknn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:33.373471 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.373429    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy" pod "9370c489-ee64-4ebe-a6cb-fa5349a7280b" (UID: "9370c489-ee64-4ebe-a6cb-fa5349a7280b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.373471 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.373435    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy" pod "ad329dfc-08aa-4c5e-acbb-21fa74563261" (UID: "ad329dfc-08aa-4c5e-acbb-21fa74563261"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.376437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.376390    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:26:33.376437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.376414    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:33.376437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.376419    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz" pod "19ef9b3f-d7e1-4803-9ed7-0353861312b9" (UID: "19ef9b3f-d7e1-4803-9ed7-0353861312b9"). InnerVolumeSpecName "kube-api-access-pt9fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:26:33.467204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467126    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467155    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467167    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467179    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467190    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467201    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467212    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467223    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467234    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467271    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467283    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467294    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467305    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n6tz\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-kube-api-access-2n6tz\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467318    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467332    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467344    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpknn\" (UniqueName: \"kubernetes.io/projected/9370c489-ee64-4ebe-a6cb-fa5349a7280b-kube-api-access-xpknn\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467355    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467366    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9370c489-ee64-4ebe-a6cb-fa5349a7280b-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467377    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9fz\" (UniqueName: \"kubernetes.io/projected/19ef9b3f-d7e1-4803-9ed7-0353861312b9-kube-api-access-pt9fz\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467389    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467402    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467414    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ef9b3f-d7e1-4803-9ed7-0353861312b9-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467426    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad329dfc-08aa-4c5e-acbb-21fa74563261-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.467577 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.467439    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad329dfc-08aa-4c5e-acbb-21fa74563261-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:26:33.896141 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.896112    4538 generic.go:356] "Generic (PLEG): container finished" podID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerID="ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9" exitCode=0
Oct 30 14:26:33.896560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.896171    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"
Oct 30 14:26:33.896560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.896201    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" event={"ID":"9370c489-ee64-4ebe-a6cb-fa5349a7280b","Type":"ContainerDied","Data":"ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9"}
Oct 30 14:26:33.896560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.896267    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2" event={"ID":"9370c489-ee64-4ebe-a6cb-fa5349a7280b","Type":"ContainerDied","Data":"4a6fd207c539cb7a5105dd67beda14ee7809e1140591135e571b5240f2497036"}
Oct 30 14:26:33.896560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.896285    4538 scope.go:122] "RemoveContainer" containerID="ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9"
Oct 30 14:26:33.899992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.899967    4538 generic.go:356] "Generic (PLEG): container finished" podID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerID="72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7" exitCode=0
Oct 30 14:26:33.900096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.900046    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"
Oct 30 14:26:33.900165 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.900046    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" event={"ID":"19ef9b3f-d7e1-4803-9ed7-0353861312b9","Type":"ContainerDied","Data":"72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7"}
Oct 30 14:26:33.900225 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.900169    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j" event={"ID":"19ef9b3f-d7e1-4803-9ed7-0353861312b9","Type":"ContainerDied","Data":"0e46fb86fd44afb6e8253a23458d509f2784cf1edab2ba0df8a0a5842e111d03"}
Oct 30 14:26:33.901522 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.901500    4538 generic.go:356] "Generic (PLEG): container finished" podID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerID="dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560" exitCode=0
Oct 30 14:26:33.901631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.901532    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" event={"ID":"ad329dfc-08aa-4c5e-acbb-21fa74563261","Type":"ContainerDied","Data":"dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560"}
Oct 30 14:26:33.901715 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.901568    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66" event={"ID":"ad329dfc-08aa-4c5e-acbb-21fa74563261","Type":"ContainerDied","Data":"804974a44a50d350865625a1245c944a64299fe17d0a939f9a6c9c28315a98f5"}
Oct 30 14:26:33.901799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.901574    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"
Oct 30 14:26:33.906805 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.906780    4538 scope.go:122] "RemoveContainer" containerID="ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9"
Oct 30 14:26:33.907156 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:33.907128    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9\": container with ID starting with ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9 not found: ID does not exist" containerID="ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9"
Oct 30 14:26:33.907274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.907164    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9"} err="failed to get container status \"ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9\": rpc error: code = NotFound desc = could not find container \"ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9\": container with ID starting with ec0a7dcb13186e456600852e563fa1cf6b9a57e6f252e374dcf99680542648d9 not found: ID does not exist"
Oct 30 14:26:33.907274 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.907187    4538 scope.go:122] "RemoveContainer" containerID="72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7"
Oct 30 14:26:33.917716 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.917696    4538 scope.go:122] "RemoveContainer" containerID="72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7"
Oct 30 14:26:33.917939 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:33.917924    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7\": container with ID starting with 72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7 not found: ID does not exist" containerID="72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7"
Oct 30 14:26:33.917984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.917945    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7"} err="failed to get container status \"72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7\": rpc error: code = NotFound desc = could not find container \"72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7\": container with ID starting with 72c4087bbf888556491200d63f1d23f440b8b67df38c17a05ec0cba73f7338e7 not found: ID does not exist"
Oct 30 14:26:33.917984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.917959    4538 scope.go:122] "RemoveContainer" containerID="dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560"
Oct 30 14:26:33.925964 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.925949    4538 scope.go:122] "RemoveContainer" containerID="dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560"
Oct 30 14:26:33.926281 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:26:33.926229    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560\": container with ID starting with dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560 not found: ID does not exist" containerID="dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560"
Oct 30 14:26:33.926351 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.926291    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560"} err="failed to get container status \"dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560\": rpc error: code = NotFound desc = could not find container \"dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560\": container with ID starting with dc56665a740f9b75a4404f389a58cc5e88c422b799b7307230b828632be53560 not found: ID does not exist"
Oct 30 14:26:33.981930 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.981904    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"]
Oct 30 14:26:33.994414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:33.994386    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-xjqc2"]
Oct 30 14:26:34.024650 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.024583    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"]
Oct 30 14:26:34.029437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.029413    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-mfh8j"]
Oct 30 14:26:34.066259 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.066226    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"]
Oct 30 14:26:34.080409 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.080388    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d2h66"]
Oct 30 14:26:34.582106 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.582074    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" path="/var/lib/kubelet/pods/19ef9b3f-d7e1-4803-9ed7-0353861312b9/volumes"
Oct 30 14:26:34.582546 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.582532    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" path="/var/lib/kubelet/pods/67dce1db-fd9e-4480-bfca-7b52d2228c19/volumes"
Oct 30 14:26:34.582917 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.582905    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" path="/var/lib/kubelet/pods/9370c489-ee64-4ebe-a6cb-fa5349a7280b/volumes"
Oct 30 14:26:34.583645 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.583630    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" path="/var/lib/kubelet/pods/ad329dfc-08aa-4c5e-acbb-21fa74563261/volumes"
Oct 30 14:26:34.584017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:34.584006    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" path="/var/lib/kubelet/pods/dbca2436-22ab-4cab-8e54-32499bd7b85f/volumes"
Oct 30 14:26:46.896030 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.895996    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"]
Oct 30 14:26:46.896470 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896456    4538 cpu_manager.go:414] "containerMap: removing container" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy"
Oct 30 14:26:46.896470 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896471    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896484    4538 cpu_manager.go:414] "containerMap: removing container" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerName="payload-pre-processing"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896489    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerName="payload-pre-processing"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896498    4538 cpu_manager.go:414] "containerMap: removing container" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896503    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896514    4538 cpu_manager.go:414] "containerMap: removing container" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896518    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896524    4538 cpu_manager.go:414] "containerMap: removing container" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896529    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896537    4538 cpu_manager.go:414] "containerMap: removing container" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy"
Oct 30 14:26:46.896539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896541    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896548    4538 cpu_manager.go:414] "containerMap: removing container" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896552    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896565    4538 cpu_manager.go:414] "containerMap: removing container" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896569    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896581    4538 cpu_manager.go:414] "containerMap: removing container" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896585    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896594    4538 cpu_manager.go:414] "containerMap: removing container" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896598    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896653    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad329dfc-08aa-4c5e-acbb-21fa74563261" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896662    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3091838-d266-4134-9f34-757353d9127c" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896669    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2edd8c5-2b47-4af3-909a-883ae54f1f16" containerName="payload-pre-processing"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896673    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="19ef9b3f-d7e1-4803-9ed7-0353861312b9" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896679    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="16dd2bf3-1d2a-4529-bd63-60f181ec75b9" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896684    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="388adf68-7b3f-4e81-b770-c468f5720ddf" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896690    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="67dce1db-fd9e-4480-bfca-7b52d2228c19" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896695    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="9370c489-ee64-4ebe-a6cb-fa5349a7280b" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896701    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="dbca2436-22ab-4cab-8e54-32499bd7b85f" containerName="istio-proxy"
Oct 30 14:26:46.896823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.896707    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="63089898-49c0-4f68-a2e1-6b68425e1f76" containerName="istio-proxy"
Oct 30 14:26:46.901879 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.901855    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.937807 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.937725    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"]
Oct 30 14:26:46.991801 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.991766    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.991935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.991881    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.991993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.991938    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.991993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.991978    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72sk5\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.992090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.991999    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.992090 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.992064    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.992162 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.992142    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.992195 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.992187    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:46.992258 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:46.992206    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.016010 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.015982    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"]
Oct 30 14:26:47.019710 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.019694    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.047586 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.047559    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"]
Oct 30 14:26:47.093407 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093377    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.093547 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093417    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.093547 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093450    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72sk5\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.093547 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093469    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.093547 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093497    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093548    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093577    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093598    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093628    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093682    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093726    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkg4r\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.093769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093748    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093815    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093862    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093914    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093919    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093972    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093989    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.093979    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.094024    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.094036    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.094127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.094080    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.098114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.094442    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.104821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.104793    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.104909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.104802    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.118316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.118292    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.118414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.118400    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72sk5\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.194904 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.194828    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.194904 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.194869    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkg4r\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.194904 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.194891    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.194913    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.194946    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.194988    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195095    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195163 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195120    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195196    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195341    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195439 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195427    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195483    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195576    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.195708 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.195658    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.197502 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.197484    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.197731 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.197712    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.215211 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.215188    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:47.219275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.219240    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.219391 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.219376    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkg4r\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.334709 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.334675    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:47.531391 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.531365    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"]
Oct 30 14:26:47.534005 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:26:47.533979    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c7a116_6df2_453c_ae8d_6783153dc4f6.slice/crio-afb81f6d0612b41c923b73b383528650ed8a0e41ca5e94dedf8b3a532bce5e29 WatchSource:0}: Error finding container afb81f6d0612b41c923b73b383528650ed8a0e41ca5e94dedf8b3a532bce5e29: Status 404 returned error can't find the container with id afb81f6d0612b41c923b73b383528650ed8a0e41ca5e94dedf8b3a532bce5e29
Oct 30 14:26:47.536293 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.536240    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:47.536359 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.536327    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:47.536393 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.536360    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:47.641828 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.641797    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"]
Oct 30 14:26:47.646009 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:26:47.645985    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5108307_a4ff_4100_96c4_71d1746a2541.slice/crio-62af6208a5a92a910b7e8b8fa7f10bd338bc7f0aa374d4a8eb25a57ea4bf250d WatchSource:0}: Error finding container 62af6208a5a92a910b7e8b8fa7f10bd338bc7f0aa374d4a8eb25a57ea4bf250d: Status 404 returned error can't find the container with id 62af6208a5a92a910b7e8b8fa7f10bd338bc7f0aa374d4a8eb25a57ea4bf250d
Oct 30 14:26:47.648479 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.648449    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:47.648562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.648513    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:47.648562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.648541    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:26:47.998657 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.998617    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" event={"ID":"e5108307-a4ff-4100-96c4-71d1746a2541","Type":"ContainerStarted","Data":"016a71a425faef3d857c6e34bc938da5935152eef1ee33205b286910d5f3fe9a"}
Oct 30 14:26:47.999171 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:47.998687    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" event={"ID":"e5108307-a4ff-4100-96c4-71d1746a2541","Type":"ContainerStarted","Data":"62af6208a5a92a910b7e8b8fa7f10bd338bc7f0aa374d4a8eb25a57ea4bf250d"}
Oct 30 14:26:48.002551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.000872    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" event={"ID":"d9c7a116-6df2-453c-ae8d-6783153dc4f6","Type":"ContainerStarted","Data":"a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089"}
Oct 30 14:26:48.002551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.000915    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" event={"ID":"d9c7a116-6df2-453c-ae8d-6783153dc4f6","Type":"ContainerStarted","Data":"afb81f6d0612b41c923b73b383528650ed8a0e41ca5e94dedf8b3a532bce5e29"}
Oct 30 14:26:48.111370 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.111294    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podStartSLOduration=2.111231165 podStartE2EDuration="2.111231165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:48.055155399 +0000 UTC m=+1201.690102041" watchObservedRunningTime="2026-10-30 14:26:48.111231165 +0000 UTC m=+1201.746177784"
Oct 30 14:26:48.111999 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.111965    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podStartSLOduration=2.111955124 podStartE2EDuration="2.111955124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:48.109179129 +0000 UTC m=+1201.744125746" watchObservedRunningTime="2026-10-30 14:26:48.111955124 +0000 UTC m=+1201.746901802"
Oct 30 14:26:48.216386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.216355    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:48.217953 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.217928    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 14:26:48.218061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.217972    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 14:26:48.346269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.343631    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:48.350270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.347371    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:48.350270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:48.347431    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:49.215809 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:49.215776    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 14:26:49.216189 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:49.215828    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 14:26:49.339271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:49.335603    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:49.339271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:49.335664    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:50.216477 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:50.216444    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 14:26:50.216873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:50.216495    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 14:26:50.335665 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:50.335629    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:50.335966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:50.335936    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:51.216155 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.216120    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 14:26:51.216344 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.216174    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 14:26:51.335678 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.335641    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:51.336284 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.336232    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:51.523011 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.522934    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"]
Oct 30 14:26:51.547271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.546966    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.591629 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.590495    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"]
Oct 30 14:26:51.673613 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.673550    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-7bf15f\"/\"distinct-2-w5-7bf15f-kserve-self-signed-certs\""
Oct 30 14:26:51.697634 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.697594    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.697797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.697666    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.697797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.697699    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.697797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.697746    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6r76\" (UniqueName: \"kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.697922 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.697820    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.697922 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.697892    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.804342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.803150    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.804342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.803235    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.804342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.803355    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.804342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.803404    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.804342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.803435    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.804342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.803479    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6r76\" (UniqueName: \"kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.805485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.805458    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.806001 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.805979    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.817830 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.806378    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.819012 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.818963    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.819132 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.819015    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.840294 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.840202    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6r76\" (UniqueName: \"kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76\") pod \"distinct-2-w5-7bf15f-kserve-574f7569cb-599nm\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") " pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:51.909494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:51.909446    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:52.216201 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:52.216170    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 14:26:52.216371 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:52.216221    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 14:26:52.271271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:52.268499    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"]
Oct 30 14:26:52.278830 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:26:52.278796    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8654b836_bfeb_491b_9f86_efa646835c0b.slice/crio-a1cd695db77c7456471871b718655c42ea0d9bc3996b5afc8ec0355a25d6f893 WatchSource:0}: Error finding container a1cd695db77c7456471871b718655c42ea0d9bc3996b5afc8ec0355a25d6f893: Status 404 returned error can't find the container with id a1cd695db77c7456471871b718655c42ea0d9bc3996b5afc8ec0355a25d6f893
Oct 30 14:26:52.336051 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:52.335642    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:52.336051 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:52.335696    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:53.072363 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.066350    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" event={"ID":"8654b836-bfeb-491b-9f86-efa646835c0b","Type":"ContainerStarted","Data":"70d4ecc98fd72d07a4ba6b6a9c526a58b324b2f915184d60d8ae0022bd6e6e27"}
Oct 30 14:26:53.072363 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.066403    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" event={"ID":"8654b836-bfeb-491b-9f86-efa646835c0b","Type":"ContainerStarted","Data":"a1cd695db77c7456471871b718655c42ea0d9bc3996b5afc8ec0355a25d6f893"}
Oct 30 14:26:53.216463 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.216432    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Oct 30 14:26:53.216629 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.216485    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Oct 30 14:26:53.337690 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.337656    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:53.338264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.338214    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:53.909877 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:53.909843    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:26:54.335536 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:54.335498    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Oct 30 14:26:54.335695 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:54.335568    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Oct 30 14:26:54.585930 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:54.585855    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:54.587111 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:54.587088    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:54.588062 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:54.588045    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:26:54.651027 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:54.649089    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" podStartSLOduration=3.649073549 podStartE2EDuration="3.649073549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:53.143754473 +0000 UTC m=+1206.778701094" watchObservedRunningTime="2026-10-30 14:26:54.649073549 +0000 UTC m=+1208.284020169"
Oct 30 14:26:55.339333 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:55.339304    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:55.339588 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:55.339570    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:26:55.340413 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:26:55.340396    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:27:01.742284 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:01.741693    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:27:01.910307 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:01.910274    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:27:01.923511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:01.923477    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:27:02.158978 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.158946    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:27:02.201273 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.201231    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"]
Oct 30 14:27:02.204127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.204107    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.223769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.223734    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-717995-openshift-default-dockercfg-h5tlx\""
Oct 30 14:27:02.230569 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.230540    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"]
Oct 30 14:27:02.355578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355546    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355578    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355614    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355731    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355759    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355775    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355934 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355893    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355934 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355915    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r55wf\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.355934 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.355931    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.456833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.456749    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.456833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.456796    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.456833 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.456812    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.456897    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.456927    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r55wf\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.456951    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457004    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457028    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457074    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457300    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457395    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457429    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457465    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.457623 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.457612    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.459363 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.459341    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.459582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.459562    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.481023 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.480993    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.481145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.481123    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r55wf\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.517998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.517969    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:02.833490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.833460    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"]
Oct 30 14:27:02.836299 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:27:02.836272    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a601862_6994_4fad_98c2_a933ff43a5fe.slice/crio-80f2f1c61526a045f4065b04c292ca84e39b06432066950b9208e705a9386637 WatchSource:0}: Error finding container 80f2f1c61526a045f4065b04c292ca84e39b06432066950b9208e705a9386637: Status 404 returned error can't find the container with id 80f2f1c61526a045f4065b04c292ca84e39b06432066950b9208e705a9386637
Oct 30 14:27:02.838997 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.838966    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:02.839070 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.839045    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:02.839108 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:02.839076    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:03.154013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:03.153920    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" event={"ID":"4a601862-6994-4fad-98c2-a933ff43a5fe","Type":"ContainerStarted","Data":"8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb"}
Oct 30 14:27:03.154013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:03.153975    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" event={"ID":"4a601862-6994-4fad-98c2-a933ff43a5fe","Type":"ContainerStarted","Data":"80f2f1c61526a045f4065b04c292ca84e39b06432066950b9208e705a9386637"}
Oct 30 14:27:03.204314 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:03.204263    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podStartSLOduration=1.204232521 podStartE2EDuration="1.204232521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:03.202363754 +0000 UTC m=+1216.837310377" watchObservedRunningTime="2026-10-30 14:27:03.204232521 +0000 UTC m=+1216.839179142"
Oct 30 14:27:03.518813 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:03.518737    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:03.520356 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:03.520336    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 14:27:03.520421 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:03.520382    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 14:27:04.518353 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:04.518322    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 14:27:04.518809 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:04.518375    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 14:27:05.519384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:05.519348    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 14:27:05.519788 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:05.519407    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 14:27:06.519021 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:06.518989    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 14:27:06.519188 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:06.519036    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 14:27:07.519329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:07.519289    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 14:27:07.519799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:07.519772    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 14:27:08.518775 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:08.518739    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Oct 30 14:27:08.518934 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:08.518803    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Oct 30 14:27:10.282644 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:10.282610    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:10.283318 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:10.283291    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:10.284175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:10.284154    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:11.455546 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:11.455511    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"]
Oct 30 14:27:11.468037 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:11.468008    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"]
Oct 30 14:27:17.104584 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:17.104543    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"]
Oct 30 14:27:19.257853 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.257821    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"]
Oct 30 14:27:19.261785 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.261769    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.282976 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.282948    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"]
Oct 30 14:27:19.291839 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.291818    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4swck\""
Oct 30 14:27:19.291839 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.291824    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 14:27:19.404882 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.404848    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.405035 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.404887    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.405176 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.405148    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9nn\" (UniqueName: \"kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.505910 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.505878    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.506068 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.505916    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.506110 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.506065    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9nn\" (UniqueName: \"kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.506567 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.506542    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.508160 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.508102    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.537821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.537791    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9nn\" (UniqueName: \"kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn\") pod \"maas-api-revoke-sub-cddf4350-kf5mn\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.574909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.574878    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:19.878609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:19.878575    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"]
Oct 30 14:27:19.881620 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:27:19.881591    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf964cfd_fdba_4f16_862d_69985d3842a0.slice/crio-c3807aae2b2650f3a74d1b9d760dcbd1f42a574cd4a660a74d198662b715d4fd WatchSource:0}: Error finding container c3807aae2b2650f3a74d1b9d760dcbd1f42a574cd4a660a74d198662b715d4fd: Status 404 returned error can't find the container with id c3807aae2b2650f3a74d1b9d760dcbd1f42a574cd4a660a74d198662b715d4fd
Oct 30 14:27:20.262048 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:20.262011    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn" event={"ID":"cf964cfd-fdba-4f16-862d-69985d3842a0","Type":"ContainerStarted","Data":"eec499359a14eaeffa10b098d28f366ee96d6a92d55fbfb66532aeaa257f0d24"}
Oct 30 14:27:20.262452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:20.262064    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn" event={"ID":"cf964cfd-fdba-4f16-862d-69985d3842a0","Type":"ContainerStarted","Data":"c3807aae2b2650f3a74d1b9d760dcbd1f42a574cd4a660a74d198662b715d4fd"}
Oct 30 14:27:20.308052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:20.308010    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn" podStartSLOduration=1.307996809 podStartE2EDuration="1.307996809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:20.306515491 +0000 UTC m=+1233.941462127" watchObservedRunningTime="2026-10-30 14:27:20.307996809 +0000 UTC m=+1233.942943428"
Oct 30 14:27:21.268702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:21.268666    4538 generic.go:356] "Generic (PLEG): container finished" podID="cf964cfd-fdba-4f16-862d-69985d3842a0" containerID="eec499359a14eaeffa10b098d28f366ee96d6a92d55fbfb66532aeaa257f0d24" exitCode=0
Oct 30 14:27:21.269110 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:21.268751    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn" event={"ID":"cf964cfd-fdba-4f16-862d-69985d3842a0","Type":"ContainerDied","Data":"eec499359a14eaeffa10b098d28f366ee96d6a92d55fbfb66532aeaa257f0d24"}
Oct 30 14:27:22.105777 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.105733    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerName="payload-processing" containerID="cri-o://a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84" gracePeriod=25
Oct 30 14:27:22.417635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.417612    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:22.549600 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.549565    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca\") pod \"cf964cfd-fdba-4f16-862d-69985d3842a0\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") "
Oct 30 14:27:22.549760 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.549620    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn\" (UniqueName: \"kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn\") pod \"cf964cfd-fdba-4f16-862d-69985d3842a0\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") "
Oct 30 14:27:22.549821 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.549799    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca\") pod \"cf964cfd-fdba-4f16-862d-69985d3842a0\" (UID: \"cf964cfd-fdba-4f16-862d-69985d3842a0\") "
Oct 30 14:27:22.550123 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.550097    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca" pod "cf964cfd-fdba-4f16-862d-69985d3842a0" (UID: "cf964cfd-fdba-4f16-862d-69985d3842a0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:27:22.550291 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.550272    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-openshift-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:22.551659 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.551637    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca" pod "cf964cfd-fdba-4f16-862d-69985d3842a0" (UID: "cf964cfd-fdba-4f16-862d-69985d3842a0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:22.551774 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.551758    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn" pod "cf964cfd-fdba-4f16-862d-69985d3842a0" (UID: "cf964cfd-fdba-4f16-862d-69985d3842a0"). InnerVolumeSpecName "kube-api-access-7w9nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:22.651480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.651415    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cf964cfd-fdba-4f16-862d-69985d3842a0-maas-api-xks-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:22.651480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:22.651442    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w9nn\" (UniqueName: \"kubernetes.io/projected/cf964cfd-fdba-4f16-862d-69985d3842a0-kube-api-access-7w9nn\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:23.281950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:23.281918    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn" event={"ID":"cf964cfd-fdba-4f16-862d-69985d3842a0","Type":"ContainerDied","Data":"c3807aae2b2650f3a74d1b9d760dcbd1f42a574cd4a660a74d198662b715d4fd"}
Oct 30 14:27:23.282098 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:23.281962    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"
Oct 30 14:27:23.282098 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:23.281973    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3807aae2b2650f3a74d1b9d760dcbd1f42a574cd4a660a74d198662b715d4fd"
Oct 30 14:27:26.475634 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.475594    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main" containerID="cri-o://66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6" gracePeriod=45
Oct 30 14:27:26.487101 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.487064    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main" containerID="cri-o://2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e" gracePeriod=45
Oct 30 14:27:26.751944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.751919    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:27:26.771918 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.771892    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:27:26.904398 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904364    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs\" (UniqueName: \"kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs\") pod \"1195db10-b66c-4897-979d-2e22f52e6eec\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") "
Oct 30 14:27:26.904582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904410    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm\") pod \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") "
Oct 30 14:27:26.904582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904475    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir\") pod \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") "
Oct 30 14:27:26.904582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904512    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm\") pod \"1195db10-b66c-4897-979d-2e22f52e6eec\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") "
Oct 30 14:27:26.904582 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904555    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache\") pod \"1195db10-b66c-4897-979d-2e22f52e6eec\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") "
Oct 30 14:27:26.904797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904602    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home\") pod \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") "
Oct 30 14:27:26.904797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904627    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs\") pod \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") "
Oct 30 14:27:26.904797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904698    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home\") pod \"1195db10-b66c-4897-979d-2e22f52e6eec\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") "
Oct 30 14:27:26.904797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904746    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz\" (UniqueName: \"kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz\") pod \"1195db10-b66c-4897-979d-2e22f52e6eec\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") "
Oct 30 14:27:26.904797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904741    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir" pod "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" (UID: "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.904797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904779    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8\" (UniqueName: \"kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8\") pod \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") "
Oct 30 14:27:26.905089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904812    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache" pod "1195db10-b66c-4897-979d-2e22f52e6eec" (UID: "1195db10-b66c-4897-979d-2e22f52e6eec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.905089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904852    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir\") pod \"1195db10-b66c-4897-979d-2e22f52e6eec\" (UID: \"1195db10-b66c-4897-979d-2e22f52e6eec\") "
Oct 30 14:27:26.905089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.904946    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache\") pod \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\" (UID: \"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b\") "
Oct 30 14:27:26.905869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.905444    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:26.905869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.905469    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:26.905869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.905482    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir" pod "1195db10-b66c-4897-979d-2e22f52e6eec" (UID: "1195db10-b66c-4897-979d-2e22f52e6eec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.905869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.905679    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home" pod "1195db10-b66c-4897-979d-2e22f52e6eec" (UID: "1195db10-b66c-4897-979d-2e22f52e6eec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.905869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.905811    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home" pod "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" (UID: "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.906328 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.906300    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache" pod "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" (UID: "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.907079 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.907054    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm" pod "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" (UID: "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.907179 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.907147    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm" pod "1195db10-b66c-4897-979d-2e22f52e6eec" (UID: "1195db10-b66c-4897-979d-2e22f52e6eec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:26.907179 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.907150    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs" pod "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" (UID: "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:26.907288 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.907204    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8" pod "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" (UID: "3fdf05fa-4f78-4541-8eaf-d8f833fdba5b"). InnerVolumeSpecName "kube-api-access-lwkq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:26.907288 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.907229    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs" pod "1195db10-b66c-4897-979d-2e22f52e6eec" (UID: "1195db10-b66c-4897-979d-2e22f52e6eec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:26.907541 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:26.907522    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz" pod "1195db10-b66c-4897-979d-2e22f52e6eec" (UID: "1195db10-b66c-4897-979d-2e22f52e6eec"). InnerVolumeSpecName "kube-api-access-5w6wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.005976    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006000    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006009    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006016    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006026    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w6wz\" (UniqueName: \"kubernetes.io/projected/1195db10-b66c-4897-979d-2e22f52e6eec-kube-api-access-5w6wz\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006035    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwkq8\" (UniqueName: \"kubernetes.io/projected/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-kube-api-access-lwkq8\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006044    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1195db10-b66c-4897-979d-2e22f52e6eec-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006052    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006060    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1195db10-b66c-4897-979d-2e22f52e6eec-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.006452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.006067    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:27.304576 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.304484    4538 generic.go:356] "Generic (PLEG): container finished" podID="1195db10-b66c-4897-979d-2e22f52e6eec" containerID="66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6" exitCode=0
Oct 30 14:27:27.304576 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.304548    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"
Oct 30 14:27:27.304813 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.304568    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" event={"ID":"1195db10-b66c-4897-979d-2e22f52e6eec","Type":"ContainerDied","Data":"66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6"}
Oct 30 14:27:27.304813 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.304613    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x" event={"ID":"1195db10-b66c-4897-979d-2e22f52e6eec","Type":"ContainerDied","Data":"32857e7a343211c68f3d99679a93d35dd806af408de21126a0e0413a7cee319c"}
Oct 30 14:27:27.304813 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.304630    4538 scope.go:122] "RemoveContainer" containerID="66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6"
Oct 30 14:27:27.306044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.306017    4538 generic.go:356] "Generic (PLEG): container finished" podID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerID="2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e" exitCode=0
Oct 30 14:27:27.306159 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.306060    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" event={"ID":"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b","Type":"ContainerDied","Data":"2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e"}
Oct 30 14:27:27.306159 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.306067    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"
Oct 30 14:27:27.306159 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.306087    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx" event={"ID":"3fdf05fa-4f78-4541-8eaf-d8f833fdba5b","Type":"ContainerDied","Data":"7c02fdcb22f7210d191b770db231e810087a279eb8ecd7bdcd26c32f07ebc7bb"}
Oct 30 14:27:27.314415 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.314383    4538 scope.go:122] "RemoveContainer" containerID="66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6"
Oct 30 14:27:27.314887 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:27.314792    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6\": container with ID starting with 66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6 not found: ID does not exist" containerID="66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6"
Oct 30 14:27:27.314887 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.314822    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6"} err="failed to get container status \"66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6\": rpc error: code = NotFound desc = could not find container \"66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6\": container with ID starting with 66ed8602b1c0c26e5ef7a8f8d22cd1ddcefdd1bc16289680dc9b3db6c1baa9d6 not found: ID does not exist"
Oct 30 14:27:27.314887 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.314859    4538 scope.go:122] "RemoveContainer" containerID="2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e"
Oct 30 14:27:27.323148 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.323128    4538 scope.go:122] "RemoveContainer" containerID="2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e"
Oct 30 14:27:27.323411 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:27.323392    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e\": container with ID starting with 2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e not found: ID does not exist" containerID="2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e"
Oct 30 14:27:27.323503 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.323416    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e"} err="failed to get container status \"2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e\": rpc error: code = NotFound desc = could not find container \"2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e\": container with ID starting with 2f5255f20fa557dfd00ce4cd417e7572c61dcd8a45309fc18e4b24307d895a1e not found: ID does not exist"
Oct 30 14:27:27.359524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.359500    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"]
Oct 30 14:27:27.371745 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.371724    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-717995/simulator-w1-717995-kserve-54885b485d-shmfx"]
Oct 30 14:27:27.401283 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.401259    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"]
Oct 30 14:27:27.406281 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.406259    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-717995/premium-w1-717995-kserve-84d77b64c-x2z9x"]
Oct 30 14:27:27.900225 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:27.900187    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:28.581165 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:28.581127    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" path="/var/lib/kubelet/pods/1195db10-b66c-4897-979d-2e22f52e6eec/volumes"
Oct 30 14:27:28.581674 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:28.581652    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" path="/var/lib/kubelet/pods/3fdf05fa-4f78-4541-8eaf-d8f833fdba5b/volumes"
Oct 30 14:27:31.620444 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:31.620408    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:27:32.140336 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140302    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"]
Oct 30 14:27:32.140759 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140744    4538 cpu_manager.go:414] "containerMap: removing container" podUID="cf964cfd-fdba-4f16-862d-69985d3842a0" containerName="revoke-keys"
Oct 30 14:27:32.140759 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140758    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf964cfd-fdba-4f16-862d-69985d3842a0" containerName="revoke-keys"
Oct 30 14:27:32.140900 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140769    4538 cpu_manager.go:414] "containerMap: removing container" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main"
Oct 30 14:27:32.140900 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140774    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main"
Oct 30 14:27:32.140900 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140804    4538 cpu_manager.go:414] "containerMap: removing container" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main"
Oct 30 14:27:32.140900 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140810    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main"
Oct 30 14:27:32.140900 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140895    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="1195db10-b66c-4897-979d-2e22f52e6eec" containerName="main"
Oct 30 14:27:32.141154 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140908    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf964cfd-fdba-4f16-862d-69985d3842a0" containerName="revoke-keys"
Oct 30 14:27:32.141154 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.140916    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fdf05fa-4f78-4541-8eaf-d8f833fdba5b" containerName="main"
Oct 30 14:27:32.145610 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.145592    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.157702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.157681    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpql\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.157818 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.157711    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.157913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.157889    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.157983 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.157939    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.158038 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.158008    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.158091 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.158049    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.158140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.158119    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.158193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.158149    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.158271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.158193    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.168103 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.168076    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"]
Oct 30 14:27:32.258938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.258902    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.258944    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.258971    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.258998    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259019    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259057    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259097    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpql\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259130 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259123    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259284    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259476    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259531    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259710 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259562    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259710 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259663    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.259839 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.259817    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.261557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.261540    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.261767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.261749    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.283746 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.283719    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.284043 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.284020    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpql\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.460645 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.460565    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:32.787372 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.787299    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"]
Oct 30 14:27:32.789953 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:27:32.789923    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbff1e9_af51_4db0_a38f_8209608273da.slice/crio-75fba0b32250bf7ac17ac5ad204c6e783d1c25bfa0af340e6799db80d74656cf WatchSource:0}: Error finding container 75fba0b32250bf7ac17ac5ad204c6e783d1c25bfa0af340e6799db80d74656cf: Status 404 returned error can't find the container with id 75fba0b32250bf7ac17ac5ad204c6e783d1c25bfa0af340e6799db80d74656cf
Oct 30 14:27:32.792114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.792082    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:32.792210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.792152    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:32.792210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:32.792195    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:33.344384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:33.344334    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" event={"ID":"8cbff1e9-af51-4db0-a38f-8209608273da","Type":"ContainerStarted","Data":"98d8da7f4af920134714190b550bd05746be2df62e0eb692ddb6ec4ad2746822"}
Oct 30 14:27:33.344556 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:33.344431    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" event={"ID":"8cbff1e9-af51-4db0-a38f-8209608273da","Type":"ContainerStarted","Data":"75fba0b32250bf7ac17ac5ad204c6e783d1c25bfa0af340e6799db80d74656cf"}
Oct 30 14:27:33.399702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:33.399634    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podStartSLOduration=1.399614518 podStartE2EDuration="1.399614518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:33.399190644 +0000 UTC m=+1247.034137263" watchObservedRunningTime="2026-10-30 14:27:33.399614518 +0000 UTC m=+1247.034561139"
Oct 30 14:27:33.461319 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:33.461288    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:33.463225 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:33.462929    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:33.463225 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:33.462995    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:34.461731 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:34.461697    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:34.462096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:34.461777    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:35.059386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:35.059348    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"]
Oct 30 14:27:35.093684 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:35.093656    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"]
Oct 30 14:27:35.098882 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:35.098860    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"]
Oct 30 14:27:35.145269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:35.126014    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"]
Oct 30 14:27:35.461074 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:35.461039    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:35.461230 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:35.461089    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:36.461932 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:36.461891    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:36.462347 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:36.461961    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:37.461452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:37.461417    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:37.461635 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:37.461468    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:37.900409 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:37.900368    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:38.460982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:38.460947    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:38.461177 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:38.461004    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:38.721203 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:38.721117    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"]
Oct 30 14:27:38.721376 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:38.721353    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" containerID="cri-o://8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb" gracePeriod=30
Oct 30 14:27:39.461326 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:39.461287    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Oct 30 14:27:39.461687 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:39.461351    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Oct 30 14:27:40.060564 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:40.060519    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerName="payload-processing" containerID="cri-o://7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1" gracePeriod=25
Oct 30 14:27:40.094005 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:40.093947    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerName="payload-pre-processing" containerID="cri-o://9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140" gracePeriod=25
Oct 30 14:27:40.286240 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:40.286198    4538 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 14:27:40.286431 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:40.286287    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 14:27:40.763210 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:40.763169    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"]
Oct 30 14:27:41.503402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.503361    4538 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 14:27:41.503552 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.503412    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:27:41.892982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.892950    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:41.893444 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.893425    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:41.894370 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.894347    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:27:41.922412 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.922374    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:41.922568 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:41.922374    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:42.369823 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.369793    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:27:42.400550 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.400518    4538 generic.go:356] "Generic (PLEG): container finished" podID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerID="a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84" exitCode=0
Oct 30 14:27:42.400700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.400564    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"
Oct 30 14:27:42.400700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.400599    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" event={"ID":"80676b23-b068-42e5-a539-1b8e3154d7a5","Type":"ContainerDied","Data":"a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84"}
Oct 30 14:27:42.400700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.400654    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5" event={"ID":"80676b23-b068-42e5-a539-1b8e3154d7a5","Type":"ContainerDied","Data":"e6557d8922bdfe1cf423fc2aecf906ce9c3bb4e875e87e45bae0fc7a74735f84"}
Oct 30 14:27:42.400700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.400687    4538 scope.go:122] "RemoveContainer" containerID="a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84"
Oct 30 14:27:42.409414 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.409393    4538 scope.go:122] "RemoveContainer" containerID="a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84"
Oct 30 14:27:42.409765 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:42.409732    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84\": container with ID starting with a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84 not found: ID does not exist" containerID="a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84"
Oct 30 14:27:42.409835 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.409777    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84"} err="failed to get container status \"a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84\": rpc error: code = NotFound desc = could not find container \"a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84\": container with ID starting with a47208822bb7b5e9ed058a9f3ce4f8a7fa2da20aa8717fe311ee2790effb4b84 not found: ID does not exist"
Oct 30 14:27:42.510524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.510444    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src\" (UniqueName: \"kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src\") pod \"80676b23-b068-42e5-a539-1b8e3154d7a5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") "
Oct 30 14:27:42.510671 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.510594    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume\") pod \"80676b23-b068-42e5-a539-1b8e3154d7a5\" (UID: \"80676b23-b068-42e5-a539-1b8e3154d7a5\") "
Oct 30 14:27:42.510963 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.510932    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume" pod "80676b23-b068-42e5-a539-1b8e3154d7a5" (UID: "80676b23-b068-42e5-a539-1b8e3154d7a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:27:42.511101 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.511086    4538 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80676b23-b068-42e5-a539-1b8e3154d7a5-plugins-config-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:42.512579 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.512555    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src" pod "80676b23-b068-42e5-a539-1b8e3154d7a5" (UID: "80676b23-b068-42e5-a539-1b8e3154d7a5"). InnerVolumeSpecName "kube-api-access-b6src". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:42.612159 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.612128    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6src\" (UniqueName: \"kubernetes.io/projected/80676b23-b068-42e5-a539-1b8e3154d7a5-kube-api-access-b6src\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:42.743218 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.743188    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"]
Oct 30 14:27:42.755609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:42.755583    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-717995-5659766595-d9jq5"]
Oct 30 14:27:44.034667 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.034585    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"]
Oct 30 14:27:44.047050 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.047027    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d95816b3-885pz"]
Oct 30 14:27:44.393054 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.393027    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:44.414836 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.414805    4538 generic.go:356] "Generic (PLEG): container finished" podID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerID="8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb" exitCode=0
Oct 30 14:27:44.415003 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.414847    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"
Oct 30 14:27:44.415003 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.414886    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" event={"ID":"4a601862-6994-4fad-98c2-a933ff43a5fe","Type":"ContainerDied","Data":"8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb"}
Oct 30 14:27:44.415003 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.414947    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6" event={"ID":"4a601862-6994-4fad-98c2-a933ff43a5fe","Type":"ContainerDied","Data":"80f2f1c61526a045f4065b04c292ca84e39b06432066950b9208e705a9386637"}
Oct 30 14:27:44.415003 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.414971    4538 scope.go:122] "RemoveContainer" containerID="8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb"
Oct 30 14:27:44.423899 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.423878    4538 scope.go:122] "RemoveContainer" containerID="8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb"
Oct 30 14:27:44.424165 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:44.424138    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb\": container with ID starting with 8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb not found: ID does not exist" containerID="8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb"
Oct 30 14:27:44.424213 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.424174    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb"} err="failed to get container status \"8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb\": rpc error: code = NotFound desc = could not find container \"8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb\": container with ID starting with 8ca7e2f136480c03a614a66417d1bc6567c3d00afcab3b901e2665abf5490ffb not found: ID does not exist"
Oct 30 14:27:44.529798 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.529769    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.529989 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.529851    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.529989 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.529876    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.529989 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.529927    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530018    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530055    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530092    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530105    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:44.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530118    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:44.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530145    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.530435 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530185    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs\") pod \"4a601862-6994-4fad-98c2-a933ff43a5fe\" (UID: \"4a601862-6994-4fad-98c2-a933ff43a5fe\") "
Oct 30 14:27:44.530654 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530628    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.530773 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530664    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.530773 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530635    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:27:44.530892 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.530868    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:44.531101 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.531082    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:44.532078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.532053    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "kube-api-access-r55wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:44.532281 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.532237    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:44.532643 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.532627    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:27:44.532711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.532700    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token" pod "4a601862-6994-4fad-98c2-a933ff43a5fe" (UID: "4a601862-6994-4fad-98c2-a933ff43a5fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:44.583809 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.583777    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="728f626e-7c29-45e5-9b65-462bfd1773f9" path="/var/lib/kubelet/pods/728f626e-7c29-45e5-9b65-462bfd1773f9/volumes"
Oct 30 14:27:44.584270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.584235    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" path="/var/lib/kubelet/pods/80676b23-b068-42e5-a539-1b8e3154d7a5/volumes"
Oct 30 14:27:44.631686 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631648    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r55wf\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-kube-api-access-r55wf\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.631686 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631689    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.631870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631704    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.631870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631719    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a601862-6994-4fad-98c2-a933ff43a5fe-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.631870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631732    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a601862-6994-4fad-98c2-a933ff43a5fe-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.631870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631744    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.631870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.631757    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a601862-6994-4fad-98c2-a933ff43a5fe-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:44.760963 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.760925    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"]
Oct 30 14:27:44.773700 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:44.773669    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-f6hq6"]
Oct 30 14:27:45.763785 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:45.763735    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerName="payload-processing" containerID="cri-o://0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3" gracePeriod=25
Oct 30 14:27:46.582320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:46.582286    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" path="/var/lib/kubelet/pods/4a601862-6994-4fad-98c2-a933ff43a5fe/volumes"
Oct 30 14:27:46.895285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:46.895170    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:47.036714 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.036683    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"]
Oct 30 14:27:47.037230 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.037206    4538 cpu_manager.go:414] "containerMap: removing container" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy"
Oct 30 14:27:47.037230 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.037224    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy"
Oct 30 14:27:47.037449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.037268    4538 cpu_manager.go:414] "containerMap: removing container" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerName="payload-processing"
Oct 30 14:27:47.037449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.037279    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerName="payload-processing"
Oct 30 14:27:47.037449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.037350    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a601862-6994-4fad-98c2-a933ff43a5fe" containerName="istio-proxy"
Oct 30 14:27:47.037449 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.037364    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="80676b23-b068-42e5-a539-1b8e3154d7a5" containerName="payload-processing"
Oct 30 14:27:47.042237 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.042215    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.062902 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.062874    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"]
Oct 30 14:27:47.158511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158421    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158491    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158525    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158622    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158727 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158671    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158792    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158830    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.158969 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158949    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc55b\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.159037 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.158990    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.259649 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.259615    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.259808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.259664    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.259808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.259695    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.259808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.259709    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.259975 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.259859    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.259975 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.259944    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260001    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260044    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260179 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260099    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260179 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260135    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc55b\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260300 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260175    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260510 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260484    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.260915 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260588    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.261007 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.260851    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.262397 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.262375    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.262486 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.262440    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.285067 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.285042    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.285175 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.285041    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc55b\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.356197 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.356173    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:47.686548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.686468    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"]
Oct 30 14:27:47.689372 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:27:47.689342    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97236a8_038b_46a7_b416_e2eff6cdc5a7.slice/crio-a78100812fa5ea8c2a4bffc153f6b9f9fe1886a33d78a2e1e17ce2463d1eff2f WatchSource:0}: Error finding container a78100812fa5ea8c2a4bffc153f6b9f9fe1886a33d78a2e1e17ce2463d1eff2f: Status 404 returned error can't find the container with id a78100812fa5ea8c2a4bffc153f6b9f9fe1886a33d78a2e1e17ce2463d1eff2f
Oct 30 14:27:47.691559 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.691530    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:47.691630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.691590    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:47.691630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:47.691620    4538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 14:27:48.454870 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:48.454838    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" event={"ID":"e97236a8-038b-46a7-b416-e2eff6cdc5a7","Type":"ContainerStarted","Data":"da062903541dbaf32c6dfd5fd2623822295ecc844d82e5654bb45f9cd52957b7"}
Oct 30 14:27:48.455276 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:48.454893    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" event={"ID":"e97236a8-038b-46a7-b416-e2eff6cdc5a7","Type":"ContainerStarted","Data":"a78100812fa5ea8c2a4bffc153f6b9f9fe1886a33d78a2e1e17ce2463d1eff2f"}
Oct 30 14:27:48.520384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:48.520336    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podStartSLOduration=1.520320739 podStartE2EDuration="1.520320739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:48.517747614 +0000 UTC m=+1262.152694234" watchObservedRunningTime="2026-10-30 14:27:48.520320739 +0000 UTC m=+1262.155267362"
Oct 30 14:27:48.646269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:48.646217    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"]
Oct 30 14:27:48.650264 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:48.646492    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh" podUID="ca3d6438-3eaf-479e-b272-59d0e7704662" containerName="maas-api" containerID="cri-o://32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b" gracePeriod=30
Oct 30 14:27:49.100623 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.100595    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:27:49.295131 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.295043    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca\") pod \"ca3d6438-3eaf-479e-b272-59d0e7704662\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") "
Oct 30 14:27:49.295844 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.295821    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls\") pod \"ca3d6438-3eaf-479e-b272-59d0e7704662\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") "
Oct 30 14:27:49.296511 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.296492    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs\") pod \"ca3d6438-3eaf-479e-b272-59d0e7704662\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") "
Oct 30 14:27:49.296668 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.296653    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq\" (UniqueName: \"kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq\") pod \"ca3d6438-3eaf-479e-b272-59d0e7704662\" (UID: \"ca3d6438-3eaf-479e-b272-59d0e7704662\") "
Oct 30 14:27:49.298020 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.295711    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca" pod "ca3d6438-3eaf-479e-b272-59d0e7704662" (UID: "ca3d6438-3eaf-479e-b272-59d0e7704662"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:27:49.309002 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.308977    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq" pod "ca3d6438-3eaf-479e-b272-59d0e7704662" (UID: "ca3d6438-3eaf-479e-b272-59d0e7704662"). InnerVolumeSpecName "kube-api-access-5w9fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:49.309164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.309142    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs" pod "ca3d6438-3eaf-479e-b272-59d0e7704662" (UID: "ca3d6438-3eaf-479e-b272-59d0e7704662"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:49.351402 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.351363    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls" pod "ca3d6438-3eaf-479e-b272-59d0e7704662" (UID: "ca3d6438-3eaf-479e-b272-59d0e7704662"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:49.360338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.360308    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:49.364367 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.364338    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:27:49.364545 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.364522    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:27:49.399096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.399067    4538 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-metrics-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:49.402454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.402435    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w9fq\" (UniqueName: \"kubernetes.io/projected/ca3d6438-3eaf-479e-b272-59d0e7704662-kube-api-access-5w9fq\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:49.402609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.402595    4538 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6438-3eaf-479e-b272-59d0e7704662-openshift-service-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:49.402697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.402685    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6438-3eaf-479e-b272-59d0e7704662-maas-api-tls\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:49.484270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.483350    4538 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6438-3eaf-479e-b272-59d0e7704662" containerID="32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b" exitCode=0
Oct 30 14:27:49.484270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.484238    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"
Oct 30 14:27:49.499297 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.499269    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh" event={"ID":"ca3d6438-3eaf-479e-b272-59d0e7704662","Type":"ContainerDied","Data":"32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b"}
Oct 30 14:27:49.499531 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.499508    4538 scope.go:122] "RemoveContainer" containerID="32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b"
Oct 30 14:27:49.499642 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.499495    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh" event={"ID":"ca3d6438-3eaf-479e-b272-59d0e7704662","Type":"ContainerDied","Data":"d899156976298703020cf224508e8e5a97fc1fcb0fae692e27059ad0b614d306"}
Oct 30 14:27:49.516765 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.516736    4538 scope.go:122] "RemoveContainer" containerID="32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b"
Oct 30 14:27:49.517116 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:27:49.517089    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b\": container with ID starting with 32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b not found: ID does not exist" containerID="32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b"
Oct 30 14:27:49.517235 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.517127    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b"} err="failed to get container status \"32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b\": rpc error: code = NotFound desc = could not find container \"32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b\": container with ID starting with 32c2a07bfe1b2365a81d294cf381ee1f7f53174198bc7b6268347d8966c0ec8b not found: ID does not exist"
Oct 30 14:27:49.567329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.566520    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"]
Oct 30 14:27:49.570685 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:49.570598    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-137f01-7cb5576cf8-d42jh"]
Oct 30 14:27:50.129297 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.124848    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" podUID="8654b836-bfeb-491b-9f86-efa646835c0b" containerName="main" containerID="cri-o://70d4ecc98fd72d07a4ba6b6a9c526a58b324b2f915184d60d8ae0022bd6e6e27" gracePeriod=45
Oct 30 14:27:50.153270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.149675    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" podUID="8654b836-bfeb-491b-9f86-efa646835c0b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.72:8000/ready\": dial tcp 10.133.0.72:8000: connect: connection refused"
Oct 30 14:27:50.185602 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.185432    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" containerID="cri-o://0a40bf7040af99f37350455f3d421379bf87302430ae3218a6aabea23074c50d" gracePeriod=45
Oct 30 14:27:50.317909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.316781    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": EOF"
Oct 30 14:27:50.356803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.356734    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:27:50.357081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.357021    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:27:50.495384 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.495268    4538 generic.go:356] "Generic (PLEG): container finished" podID="8654b836-bfeb-491b-9f86-efa646835c0b" containerID="70d4ecc98fd72d07a4ba6b6a9c526a58b324b2f915184d60d8ae0022bd6e6e27" exitCode=0
Oct 30 14:27:50.499119 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.499090    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" event={"ID":"8654b836-bfeb-491b-9f86-efa646835c0b","Type":"ContainerDied","Data":"70d4ecc98fd72d07a4ba6b6a9c526a58b324b2f915184d60d8ae0022bd6e6e27"}
Oct 30 14:27:50.501655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.501632    4538 generic.go:356] "Generic (PLEG): container finished" podID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerID="0a40bf7040af99f37350455f3d421379bf87302430ae3218a6aabea23074c50d" exitCode=0
Oct 30 14:27:50.501970 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.501794    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" event={"ID":"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c","Type":"ContainerDied","Data":"0a40bf7040af99f37350455f3d421379bf87302430ae3218a6aabea23074c50d"}
Oct 30 14:27:50.691600 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:50.691563    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca3d6438-3eaf-479e-b272-59d0e7704662" path="/var/lib/kubelet/pods/ca3d6438-3eaf-479e-b272-59d0e7704662/volumes"
Oct 30 14:27:51.194673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.177401    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": dial tcp 10.133.0.40:8000: connect: connection refused"
Oct 30 14:27:51.194673 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.177517    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:27:51.203267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.200493    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:27:51.366297 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.360759    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:27:51.366297 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.360830    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:27:51.378722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.378413    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache\") pod \"8654b836-bfeb-491b-9f86-efa646835c0b\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") "
Oct 30 14:27:51.378722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.378490    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76\" (UniqueName: \"kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76\") pod \"8654b836-bfeb-491b-9f86-efa646835c0b\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") "
Oct 30 14:27:51.378722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.378553    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir\") pod \"8654b836-bfeb-491b-9f86-efa646835c0b\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") "
Oct 30 14:27:51.378722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.378583    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home\") pod \"8654b836-bfeb-491b-9f86-efa646835c0b\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") "
Oct 30 14:27:51.378722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.378617    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm\") pod \"8654b836-bfeb-491b-9f86-efa646835c0b\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") "
Oct 30 14:27:51.378722 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.378707    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs\" (UniqueName: \"kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs\") pod \"8654b836-bfeb-491b-9f86-efa646835c0b\" (UID: \"8654b836-bfeb-491b-9f86-efa646835c0b\") "
Oct 30 14:27:51.379862 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.379833    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache" pod "8654b836-bfeb-491b-9f86-efa646835c0b" (UID: "8654b836-bfeb-491b-9f86-efa646835c0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.380386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.380363    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir" pod "8654b836-bfeb-491b-9f86-efa646835c0b" (UID: "8654b836-bfeb-491b-9f86-efa646835c0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.380712 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.380693    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home" pod "8654b836-bfeb-491b-9f86-efa646835c0b" (UID: "8654b836-bfeb-491b-9f86-efa646835c0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.384209 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.384182    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76" pod "8654b836-bfeb-491b-9f86-efa646835c0b" (UID: "8654b836-bfeb-491b-9f86-efa646835c0b"). InnerVolumeSpecName "kube-api-access-f6r76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:51.384654 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.384617    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs" pod "8654b836-bfeb-491b-9f86-efa646835c0b" (UID: "8654b836-bfeb-491b-9f86-efa646835c0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:51.384845 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.384824    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm" pod "8654b836-bfeb-491b-9f86-efa646835c0b" (UID: "8654b836-bfeb-491b-9f86-efa646835c0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.428513 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.428487    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:27:51.480085 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480055    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir\") pod \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") "
Oct 30 14:27:51.480234 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480091    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home\") pod \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") "
Oct 30 14:27:51.480234 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480207    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm\") pod \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") "
Oct 30 14:27:51.480393 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480285    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs\" (UniqueName: \"kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs\") pod \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") "
Oct 30 14:27:51.481096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480764    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home" pod "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" (UID: "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.481096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480803    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir" pod "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" (UID: "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.481096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480852    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache\") pod \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") "
Oct 30 14:27:51.481096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.480923    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq\" (UniqueName: \"kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq\") pod \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\" (UID: \"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c\") "
Oct 30 14:27:51.481437 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.481132    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache" pod "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" (UID: "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482620    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8654b836-bfeb-491b-9f86-efa646835c0b-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482724    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482738    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482750    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482763    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482804    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6r76\" (UniqueName: \"kubernetes.io/projected/8654b836-bfeb-491b-9f86-efa646835c0b-kube-api-access-f6r76\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482866    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482880    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.482908 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.482895    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8654b836-bfeb-491b-9f86-efa646835c0b-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.483438 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.483331    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm" pod "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" (UID: "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:27:51.494781 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.494758    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs" pod "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" (UID: "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:27:51.495405 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.494986    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq" pod "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" (UID: "d98bcd5b-61d8-4e78-92f1-f08f63e76f2c"). InnerVolumeSpecName "kube-api-access-zk8lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:27:51.508800 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.508778    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"
Oct 30 14:27:51.508800 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.508786    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk" event={"ID":"d98bcd5b-61d8-4e78-92f1-f08f63e76f2c","Type":"ContainerDied","Data":"a97e799a3540562d54aa26a5bbbd24c3ee8f0fa682285c9fc9e04db2cb64ce26"}
Oct 30 14:27:51.508925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.508832    4538 scope.go:122] "RemoveContainer" containerID="0a40bf7040af99f37350455f3d421379bf87302430ae3218a6aabea23074c50d"
Oct 30 14:27:51.510502 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.510473    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm" event={"ID":"8654b836-bfeb-491b-9f86-efa646835c0b","Type":"ContainerDied","Data":"a1cd695db77c7456471871b718655c42ea0d9bc3996b5afc8ec0355a25d6f893"}
Oct 30 14:27:51.510609 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.510532    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"
Oct 30 14:27:51.518584 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.518566    4538 scope.go:122] "RemoveContainer" containerID="70d4ecc98fd72d07a4ba6b6a9c526a58b324b2f915184d60d8ae0022bd6e6e27"
Oct 30 14:27:51.578517 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.578453    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"]
Oct 30 14:27:51.582886 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.582860    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/distinct-2-w5-7bf15f-kserve-574f7569cb-599nm"]
Oct 30 14:27:51.584115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.584097    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.584173 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.584117    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.584173 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.584129    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk8lq\" (UniqueName: \"kubernetes.io/projected/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c-kube-api-access-zk8lq\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:27:51.651107 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.651070    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"]
Oct 30 14:27:51.665010 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.664979    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-7bf15f/simulator-w5-7bf15f-kserve-7968b7d789-pzkdk"]
Oct 30 14:27:51.922302 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.922239    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:51.922515 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:51.922300    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:52.356990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:52.356954    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:27:52.357147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:52.357005    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:27:52.581728 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:52.581695    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8654b836-bfeb-491b-9f86-efa646835c0b" path="/var/lib/kubelet/pods/8654b836-bfeb-491b-9f86-efa646835c0b/volumes"
Oct 30 14:27:52.582122 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:52.582102    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" path="/var/lib/kubelet/pods/d98bcd5b-61d8-4e78-92f1-f08f63e76f2c/volumes"
Oct 30 14:27:53.356869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:53.356837    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:27:53.357029 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:53.356883    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:27:54.038050 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:54.038013    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"]
Oct 30 14:27:54.050491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:54.050464    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-caa57078-wsjwl"]
Oct 30 14:27:54.356990 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:54.356954    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:27:54.357155 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:54.357029    4538 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:27:54.582228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:54.582192    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cde5516-21a8-4856-b29e-cee356d8f358" path="/var/lib/kubelet/pods/7cde5516-21a8-4856-b29e-cee356d8f358/volumes"
Oct 30 14:27:55.361159 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:55.361131    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:55.361599 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:55.361580    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:55.362109 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:55.362090    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:27:56.895855 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:56.895820    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 14:27:57.423131 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:57.423072    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"]
Oct 30 14:27:57.423759 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:57.423727    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy" containerID="cri-o://016a71a425faef3d857c6e34bc938da5935152eef1ee33205b286910d5f3fe9a" gracePeriod=30
Oct 30 14:27:57.442895 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:57.442863    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"]
Oct 30 14:27:57.443688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:57.443661    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy" containerID="cri-o://98d8da7f4af920134714190b550bd05746be2df62e0eb692ddb6ec4ad2746822" gracePeriod=30
Oct 30 14:27:57.455799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:57.454633    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"]
Oct 30 14:27:57.455799 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:27:57.454872    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy" containerID="cri-o://0accb1593ddd5dcfa7aa76babb879e3d2d65f8587e5995b8eab82b904303a8c2" gracePeriod=30
Oct 30 14:28:00.354782 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.354755    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:28:00.383395 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.383375    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:28:00.415340 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.415310    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c\" (UniqueName: \"kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c\") pod \"06de232b-9dbe-4144-abde-db72a2bddbf5\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") "
Oct 30 14:28:00.415498 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.415474    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume\") pod \"06de232b-9dbe-4144-abde-db72a2bddbf5\" (UID: \"06de232b-9dbe-4144-abde-db72a2bddbf5\") "
Oct 30 14:28:00.415819 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.415797    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume" pod "06de232b-9dbe-4144-abde-db72a2bddbf5" (UID: "06de232b-9dbe-4144-abde-db72a2bddbf5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:00.417280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.417260    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c" pod "06de232b-9dbe-4144-abde-db72a2bddbf5" (UID: "06de232b-9dbe-4144-abde-db72a2bddbf5"). InnerVolumeSpecName "kube-api-access-qts7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:00.516539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.516509    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume\") pod \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") "
Oct 30 14:28:00.516712 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.516663    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t\" (UniqueName: \"kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t\") pod \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\" (UID: \"c334095f-eacd-42a2-ba0b-a6f819fd45f2\") "
Oct 30 14:28:00.516884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.516870    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qts7c\" (UniqueName: \"kubernetes.io/projected/06de232b-9dbe-4144-abde-db72a2bddbf5-kube-api-access-qts7c\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:00.516926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.516873    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume" pod "c334095f-eacd-42a2-ba0b-a6f819fd45f2" (UID: "c334095f-eacd-42a2-ba0b-a6f819fd45f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:00.516926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.516886    4538 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06de232b-9dbe-4144-abde-db72a2bddbf5-plugins-config-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:00.518643 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.518624    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t" pod "c334095f-eacd-42a2-ba0b-a6f819fd45f2" (UID: "c334095f-eacd-42a2-ba0b-a6f819fd45f2"). InnerVolumeSpecName "kube-api-access-xbt8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:00.579744 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.579712    4538 generic.go:356] "Generic (PLEG): container finished" podID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerID="9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140" exitCode=0
Oct 30 14:28:00.579912 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.579825    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"
Oct 30 14:28:00.581350 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.581240    4538 generic.go:356] "Generic (PLEG): container finished" podID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerID="7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1" exitCode=0
Oct 30 14:28:00.581494 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.581394    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"
Oct 30 14:28:00.582750 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.582724    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" event={"ID":"c334095f-eacd-42a2-ba0b-a6f819fd45f2","Type":"ContainerDied","Data":"9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140"}
Oct 30 14:28:00.582878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.582779    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k" event={"ID":"c334095f-eacd-42a2-ba0b-a6f819fd45f2","Type":"ContainerDied","Data":"ae0801697a6037c5f2e2ee19dcbd30542f5da579804195fcd5e07eb57aa2158d"}
Oct 30 14:28:00.582878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.582808    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" event={"ID":"06de232b-9dbe-4144-abde-db72a2bddbf5","Type":"ContainerDied","Data":"7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1"}
Oct 30 14:28:00.582878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.582833    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt" event={"ID":"06de232b-9dbe-4144-abde-db72a2bddbf5","Type":"ContainerDied","Data":"41c00cc6606bb188eb546601146dfd85073d78fc194c85cd91d23e668a3dfee9"}
Oct 30 14:28:00.582878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.582849    4538 scope.go:122] "RemoveContainer" containerID="9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140"
Oct 30 14:28:00.594201 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.594184    4538 scope.go:122] "RemoveContainer" containerID="9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140"
Oct 30 14:28:00.594557 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:00.594537    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140\": container with ID starting with 9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140 not found: ID does not exist" containerID="9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140"
Oct 30 14:28:00.594642 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.594565    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140"} err="failed to get container status \"9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140\": rpc error: code = NotFound desc = could not find container \"9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140\": container with ID starting with 9ff860be1770f3a1fed01f3cab41060fedf950e4d204122c353699d635000140 not found: ID does not exist"
Oct 30 14:28:00.594642 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.594583    4538 scope.go:122] "RemoveContainer" containerID="7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1"
Oct 30 14:28:00.603013 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.602997    4538 scope.go:122] "RemoveContainer" containerID="7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1"
Oct 30 14:28:00.603282 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:00.603263    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1\": container with ID starting with 7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1 not found: ID does not exist" containerID="7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1"
Oct 30 14:28:00.603340 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.603289    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1"} err="failed to get container status \"7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1\": rpc error: code = NotFound desc = could not find container \"7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1\": container with ID starting with 7f917c1d780ca96fe5265d39ede73e02b03eac2e049baaf48589ba7bb8820da1 not found: ID does not exist"
Oct 30 14:28:00.617837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.617813    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbt8t\" (UniqueName: \"kubernetes.io/projected/c334095f-eacd-42a2-ba0b-a6f819fd45f2-kube-api-access-xbt8t\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:00.617837 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.617835    4538 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c334095f-eacd-42a2-ba0b-a6f819fd45f2-plugins-config-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:00.634322 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.634296    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"]
Oct 30 14:28:00.639114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.639096    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-137f01-766cd84bbc-jd55k"]
Oct 30 14:28:00.677095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.677071    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"]
Oct 30 14:28:00.681636 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:00.681615    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-137f01-7b9f8997bf-b8blt"]
Oct 30 14:28:01.618810 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:01.618774    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:28:02.584554 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.584525    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" path="/var/lib/kubelet/pods/06de232b-9dbe-4144-abde-db72a2bddbf5/volumes"
Oct 30 14:28:02.585145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.584892    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" path="/var/lib/kubelet/pods/c334095f-eacd-42a2-ba0b-a6f819fd45f2/volumes"
Oct 30 14:28:02.597640 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.597610    4538 generic.go:356] "Generic (PLEG): container finished" podID="8cbff1e9-af51-4db0-a38f-8209608273da" containerID="98d8da7f4af920134714190b550bd05746be2df62e0eb692ddb6ec4ad2746822" exitCode=0
Oct 30 14:28:02.597832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.597815    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" event={"ID":"8cbff1e9-af51-4db0-a38f-8209608273da","Type":"ContainerDied","Data":"98d8da7f4af920134714190b550bd05746be2df62e0eb692ddb6ec4ad2746822"}
Oct 30 14:28:02.599992 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.599964    4538 generic.go:356] "Generic (PLEG): container finished" podID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerID="0accb1593ddd5dcfa7aa76babb879e3d2d65f8587e5995b8eab82b904303a8c2" exitCode=0
Oct 30 14:28:02.600092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.600036    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" event={"ID":"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f","Type":"ContainerDied","Data":"0accb1593ddd5dcfa7aa76babb879e3d2d65f8587e5995b8eab82b904303a8c2"}
Oct 30 14:28:02.601935 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.601915    4538 generic.go:356] "Generic (PLEG): container finished" podID="e5108307-a4ff-4100-96c4-71d1746a2541" containerID="016a71a425faef3d857c6e34bc938da5935152eef1ee33205b286910d5f3fe9a" exitCode=0
Oct 30 14:28:02.602018 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.601947    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" event={"ID":"e5108307-a4ff-4100-96c4-71d1746a2541","Type":"ContainerDied","Data":"016a71a425faef3d857c6e34bc938da5935152eef1ee33205b286910d5f3fe9a"}
Oct 30 14:28:02.650534 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.650506    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:28:02.689828 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.689801    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:28:02.708452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.708425    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:28:02.740329 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740298    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740350    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740392    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740449    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740499    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740560    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740606    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740622    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.740736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740652    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.740736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740690    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.740736 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740725    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs\") pod \"e5108307-a4ff-4100-96c4-71d1746a2541\" (UID: \"e5108307-a4ff-4100-96c4-71d1746a2541\") "
Oct 30 14:28:02.741056 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740906    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.741056 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.740988    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:02.741170 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.741089    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.741420 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.741401    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5108307-a4ff-4100-96c4-71d1746a2541-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.741493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.741425    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.741493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.741441    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.741493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.741453    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.741493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.741466    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.742646 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.742624    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "kube-api-access-hkg4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:02.742957 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.742940    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.743225 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.743200    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:28:02.743348 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.743202    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token" pod "e5108307-a4ff-4100-96c4-71d1746a2541" (UID: "e5108307-a4ff-4100-96c4-71d1746a2541"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:02.842334 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842302    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.842525 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842351    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.842525 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842399    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.842525 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842429    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.842525 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842489    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.842525 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842518    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.842792 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842582    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.842867 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842845    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.842942 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842926    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.842995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842934    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.842995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.842965    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.843103 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843016    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.843103 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843044    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.843103 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843074    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.843275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843139    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.843275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843171    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.843275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843188    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:02.843275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843207    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.843275 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843236    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data\") pod \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\" (UID: \"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f\") "
Oct 30 14:28:02.843524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843299    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.843524 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843341    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket\") pod \"8cbff1e9-af51-4db0-a38f-8209608273da\" (UID: \"8cbff1e9-af51-4db0-a38f-8209608273da\") "
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843729    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843753    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843768    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkg4r\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-kube-api-access-hkg4r\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843782    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5108307-a4ff-4100-96c4-71d1746a2541-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843789    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843795    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843822    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5108307-a4ff-4100-96c4-71d1746a2541-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843818    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.843884 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.843834    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5108307-a4ff-4100-96c4-71d1746a2541-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.844991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.844014    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.844991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.844034    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.844991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.844170    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.844991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.844238    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:02.844991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.844439    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.845382 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.845358    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:02.846021 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.845963    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.846129 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.846099    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:28:02.846732 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.846706    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:02.846898 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.846879    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:28:02.847161 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.847143    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp" pod "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" (UID: "2ff8fbdb-84f8-4c46-9f34-ff508b8b008f"). InnerVolumeSpecName "kube-api-access-wx6tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:02.847762 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.847745    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "kube-api-access-dkpql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:02.848040 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.848025    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy" pod "8cbff1e9-af51-4db0-a38f-8209608273da" (UID: "8cbff1e9-af51-4db0-a38f-8209608273da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:02.945047 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945007    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945047 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945032    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkpql\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-kube-api-access-dkpql\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945047 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945041    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945047 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945050    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945047 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945058    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945065    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx6tp\" (UniqueName: \"kubernetes.io/projected/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-kube-api-access-wx6tp\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945074    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cbff1e9-af51-4db0-a38f-8209608273da-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945082    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945091    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945098    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945107    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945114    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cbff1e9-af51-4db0-a38f-8209608273da-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945121    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cbff1e9-af51-4db0-a38f-8209608273da-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945134    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:02.945487 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:02.945146    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cbff1e9-af51-4db0-a38f-8209608273da-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:03.608540 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.608507    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"
Oct 30 14:28:03.608540 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.608512    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b" event={"ID":"2ff8fbdb-84f8-4c46-9f34-ff508b8b008f","Type":"ContainerDied","Data":"ed176fe6b06bc4c52d44eddf4e739f2dd6393f328ce60e4a44944d985af3553a"}
Oct 30 14:28:03.608830 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.608569    4538 scope.go:122] "RemoveContainer" containerID="0accb1593ddd5dcfa7aa76babb879e3d2d65f8587e5995b8eab82b904303a8c2"
Oct 30 14:28:03.610052 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.610012    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq" event={"ID":"e5108307-a4ff-4100-96c4-71d1746a2541","Type":"ContainerDied","Data":"62af6208a5a92a910b7e8b8fa7f10bd338bc7f0aa374d4a8eb25a57ea4bf250d"}
Oct 30 14:28:03.610178 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.610027    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"
Oct 30 14:28:03.611380 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.611364    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"
Oct 30 14:28:03.611452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.611402    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq" event={"ID":"8cbff1e9-af51-4db0-a38f-8209608273da","Type":"ContainerDied","Data":"75fba0b32250bf7ac17ac5ad204c6e783d1c25bfa0af340e6799db80d74656cf"}
Oct 30 14:28:03.619734 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.619719    4538 scope.go:122] "RemoveContainer" containerID="016a71a425faef3d857c6e34bc938da5935152eef1ee33205b286910d5f3fe9a"
Oct 30 14:28:03.627749 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.627727    4538 scope.go:122] "RemoveContainer" containerID="98d8da7f4af920134714190b550bd05746be2df62e0eb692ddb6ec4ad2746822"
Oct 30 14:28:03.676065 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.676034    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"]
Oct 30 14:28:03.688170 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.688146    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-hphfq"]
Oct 30 14:28:03.716091 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.716030    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"]
Oct 30 14:28:03.721111 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.720989    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-cwb8b"]
Oct 30 14:28:03.756547 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.756523    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"]
Oct 30 14:28:03.761399 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:03.761380    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-bhzrq"]
Oct 30 14:28:04.583993 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:04.583964    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" path="/var/lib/kubelet/pods/2ff8fbdb-84f8-4c46-9f34-ff508b8b008f/volumes"
Oct 30 14:28:04.584430 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:04.584413    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" path="/var/lib/kubelet/pods/8cbff1e9-af51-4db0-a38f-8209608273da/volumes"
Oct 30 14:28:04.584808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:04.584796    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" path="/var/lib/kubelet/pods/e5108307-a4ff-4100-96c4-71d1746a2541/volumes"
Oct 30 14:28:05.315768 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:05.315737    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"]
Oct 30 14:28:05.316212 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:05.315944    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" containerID="cri-o://da062903541dbaf32c6dfd5fd2623822295ecc844d82e5654bb45f9cd52957b7" gracePeriod=30
Oct 30 14:28:05.328914 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:05.328884    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"]
Oct 30 14:28:05.329144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:05.329120    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" containerID="cri-o://f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262" gracePeriod=30
Oct 30 14:28:05.339409 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:05.339377    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"]
Oct 30 14:28:05.339615 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:05.339593    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" containerID="cri-o://a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089" gracePeriod=30
Oct 30 14:28:06.018941 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.018910    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:28:06.076903 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.076830    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume\") pod \"31a86e21-1d17-4d0b-8e73-0d3afaead401\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") "
Oct 30 14:28:06.076903 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.076889    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm\" (UniqueName: \"kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm\") pod \"31a86e21-1d17-4d0b-8e73-0d3afaead401\" (UID: \"31a86e21-1d17-4d0b-8e73-0d3afaead401\") "
Oct 30 14:28:06.077179 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.077154    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume" pod "31a86e21-1d17-4d0b-8e73-0d3afaead401" (UID: "31a86e21-1d17-4d0b-8e73-0d3afaead401"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:06.078962 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.078936    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm" pod "31a86e21-1d17-4d0b-8e73-0d3afaead401" (UID: "31a86e21-1d17-4d0b-8e73-0d3afaead401"). InnerVolumeSpecName "kube-api-access-ztjfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:06.178139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.178107    4538 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31a86e21-1d17-4d0b-8e73-0d3afaead401-plugins-config-volume\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:06.178139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.178136    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztjfm\" (UniqueName: \"kubernetes.io/projected/31a86e21-1d17-4d0b-8e73-0d3afaead401-kube-api-access-ztjfm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:06.631711 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.631678    4538 generic.go:356] "Generic (PLEG): container finished" podID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerID="0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3" exitCode=0
Oct 30 14:28:06.632182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.631739    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"
Oct 30 14:28:06.632182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.631770    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" event={"ID":"31a86e21-1d17-4d0b-8e73-0d3afaead401","Type":"ContainerDied","Data":"0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3"}
Oct 30 14:28:06.632182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.631826    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv" event={"ID":"31a86e21-1d17-4d0b-8e73-0d3afaead401","Type":"ContainerDied","Data":"4ada1f260827050677d540ed10c3be8131bc60c7beb56735599d49aaf2da49a7"}
Oct 30 14:28:06.632182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.631852    4538 scope.go:122] "RemoveContainer" containerID="0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3"
Oct 30 14:28:06.640782 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.640765    4538 scope.go:122] "RemoveContainer" containerID="0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3"
Oct 30 14:28:06.641058 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:06.641041    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3\": container with ID starting with 0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3 not found: ID does not exist" containerID="0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3"
Oct 30 14:28:06.641105 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.641067    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3"} err="failed to get container status \"0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3\": rpc error: code = NotFound desc = could not find container \"0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3\": container with ID starting with 0460f425231b1a1979067b094d19a48f1a27c508511be4a4b40b5eff11253de3 not found: ID does not exist"
Oct 30 14:28:06.686526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.686499    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"]
Oct 30 14:28:06.698996 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:06.698972    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-7bf15f-c6dc6d96f-bmzcv"]
Oct 30 14:28:08.530164 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:08.530131    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 14:28:08.530626 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:08.530182    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 14:28:08.581190 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:08.581159    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" path="/var/lib/kubelet/pods/31a86e21-1d17-4d0b-8e73-0d3afaead401/volumes"
Oct 30 14:28:09.589697 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:09.589666    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 14:28:09.590070 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:09.589715    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 14:28:10.362490 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.362463    4538 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Oct 30 14:28:10.362610 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.362516    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Oct 30 14:28:10.605195 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.605133    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:28:10.652601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.652575    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:28:10.653924 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.653891    4538 generic.go:356] "Generic (PLEG): container finished" podID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerID="a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089" exitCode=0
Oct 30 14:28:10.654224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.653959    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" event={"ID":"d9c7a116-6df2-453c-ae8d-6783153dc4f6","Type":"ContainerDied","Data":"a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089"}
Oct 30 14:28:10.654224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.654017    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh" event={"ID":"d9c7a116-6df2-453c-ae8d-6783153dc4f6","Type":"ContainerDied","Data":"afb81f6d0612b41c923b73b383528650ed8a0e41ca5e94dedf8b3a532bce5e29"}
Oct 30 14:28:10.654224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.654050    4538 scope.go:122] "RemoveContainer" containerID="a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089"
Oct 30 14:28:10.656198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.656076    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:28:10.656198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.656100    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" event={"ID":"e97236a8-038b-46a7-b416-e2eff6cdc5a7","Type":"ContainerDied","Data":"da062903541dbaf32c6dfd5fd2623822295ecc844d82e5654bb45f9cd52957b7"}
Oct 30 14:28:10.656198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.656078    4538 generic.go:356] "Generic (PLEG): container finished" podID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerID="da062903541dbaf32c6dfd5fd2623822295ecc844d82e5654bb45f9cd52957b7" exitCode=0
Oct 30 14:28:10.656198 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.656140    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5" event={"ID":"e97236a8-038b-46a7-b416-e2eff6cdc5a7","Type":"ContainerDied","Data":"a78100812fa5ea8c2a4bffc153f6b9f9fe1886a33d78a2e1e17ce2463d1eff2f"}
Oct 30 14:28:10.656433 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.656298    4538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a78100812fa5ea8c2a4bffc153f6b9f9fe1886a33d78a2e1e17ce2463d1eff2f"
Oct 30 14:28:10.658036 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.658015    4538 generic.go:356] "Generic (PLEG): container finished" podID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerID="f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262" exitCode=0
Oct 30 14:28:10.658137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.658089    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" event={"ID":"8af36ee1-3a0d-4165-a048-0b4be7219f4f","Type":"ContainerDied","Data":"f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262"}
Oct 30 14:28:10.658137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.658119    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r" event={"ID":"8af36ee1-3a0d-4165-a048-0b4be7219f4f","Type":"ContainerDied","Data":"965fb075b6268e9a9f776e28c23ab8739d257ac72c14eb15b50f4fa80666dc88"}
Oct 30 14:28:10.658287 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.658191    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"
Oct 30 14:28:10.664114 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.664099    4538 scope.go:122] "RemoveContainer" containerID="a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089"
Oct 30 14:28:10.668144 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:10.664401    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089\": container with ID starting with a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089 not found: ID does not exist" containerID="a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089"
Oct 30 14:28:10.668144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.664437    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089"} err="failed to get container status \"a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089\": rpc error: code = NotFound desc = could not find container \"a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089\": container with ID starting with a2426f21088bb521bb1b0f188e2c5a15b1ab2d72c422bb7c0e62e0c74c8f0089 not found: ID does not exist"
Oct 30 14:28:10.668144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.664458    4538 scope.go:122] "RemoveContainer" containerID="f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262"
Oct 30 14:28:10.673945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.673929    4538 scope.go:122] "RemoveContainer" containerID="f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262"
Oct 30 14:28:10.674215 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:10.674198    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262\": container with ID starting with f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262 not found: ID does not exist" containerID="f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262"
Oct 30 14:28:10.674316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.674221    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262"} err="failed to get container status \"f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262\": rpc error: code = NotFound desc = could not find container \"f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262\": container with ID starting with f0d244a798f7e8660ec42120297734f53b4fc6f171ef1fe96985648e70090262 not found: ID does not exist"
Oct 30 14:28:10.724139 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724106    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724141    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724210    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724268    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724301 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724296    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724333    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724372    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724404    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724507 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724439    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket\") pod \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\" (UID: \"8af36ee1-3a0d-4165-a048-0b4be7219f4f\") "
Oct 30 14:28:10.724713 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724690    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.724878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724857    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.724878 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724872    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.725061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.724967    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.725117 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.725096    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:10.725194 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.725029    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.726803 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.726781    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.727152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.727126    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:28:10.727282 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.727162    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:10.727282 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.727171    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g" pod "8af36ee1-3a0d-4165-a048-0b4be7219f4f" (UID: "8af36ee1-3a0d-4165-a048-0b4be7219f4f"). InnerVolumeSpecName "kube-api-access-qp69g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:10.825286 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825229    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.825457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825314    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.825457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825349    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.825457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825378    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.825457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825416    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.825457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825448    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825499    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825517    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825528    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825595    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825651    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825686    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.825730 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825726    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825774    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825820    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825848    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825875    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825885    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825904    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert\") pod \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\" (UID: \"d9c7a116-6df2-453c-ae8d-6783153dc4f6\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.825942    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert\") pod \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\" (UID: \"e97236a8-038b-46a7-b416-e2eff6cdc5a7\") "
Oct 30 14:28:10.826081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826016    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826348    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826369    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp69g\" (UniqueName: \"kubernetes.io/projected/8af36ee1-3a0d-4165-a048-0b4be7219f4f-kube-api-access-qp69g\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826383    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826399    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826432    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826446    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826447    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826461    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826475    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826487    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826501    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af36ee1-3a0d-4165-a048-0b4be7219f4f-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.826526 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826514    4538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af36ee1-3a0d-4165-a048-0b4be7219f4f-workload-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.827137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826772    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.827137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.826832    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:10.827137 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.827058    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.827320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.827261    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.827320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.827278    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.827472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.827452    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:28:10.828147 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.828108    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "kube-api-access-72sk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:10.828653 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.828608    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.828826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.828694    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:10.828826 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.828801    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:28:10.829110 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.829083    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:28:10.829386 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.829368    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token" pod "d9c7a116-6df2-453c-ae8d-6783153dc4f6" (UID: "d9c7a116-6df2-453c-ae8d-6783153dc4f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:10.829467 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.829442    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "kube-api-access-qc55b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:28:10.829986 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.829971    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo" pod "e97236a8-038b-46a7-b416-e2eff6cdc5a7" (UID: "e97236a8-038b-46a7-b416-e2eff6cdc5a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927430    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927460    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927470    4538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-data\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927478    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927495    4538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istiod-ca-cert\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927503    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927510    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927518    4538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-envoy\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927518 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927526    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72sk5\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-kube-api-access-72sk5\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927536    4538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9c7a116-6df2-453c-ae8d-6783153dc4f6-credential-socket\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927545    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e97236a8-038b-46a7-b416-e2eff6cdc5a7-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927552    4538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97236a8-038b-46a7-b416-e2eff6cdc5a7-workload-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927560    4538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-token\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927568    4538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9c7a116-6df2-453c-ae8d-6783153dc4f6-istio-podinfo\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:10.927913 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:10.927575    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc55b\" (UniqueName: \"kubernetes.io/projected/e97236a8-038b-46a7-b416-e2eff6cdc5a7-kube-api-access-qc55b\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:28:11.004457 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.004425    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"]
Oct 30 14:28:11.009321 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.009293    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-vlc6r"]
Oct 30 14:28:11.664679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.664587    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"
Oct 30 14:28:11.665938 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.665915    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"
Oct 30 14:28:11.722412 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.722383    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"]
Oct 30 14:28:11.734972 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.734946    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-qwkxh"]
Oct 30 14:28:11.760664 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.760633    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"]
Oct 30 14:28:11.765605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:11.765583    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-ddfm5"]
Oct 30 14:28:12.582057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:12.582025    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" path="/var/lib/kubelet/pods/8af36ee1-3a0d-4165-a048-0b4be7219f4f/volumes"
Oct 30 14:28:12.582675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:12.582655    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" path="/var/lib/kubelet/pods/d9c7a116-6df2-453c-ae8d-6783153dc4f6/volumes"
Oct 30 14:28:12.583238 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:12.583219    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" path="/var/lib/kubelet/pods/e97236a8-038b-46a7-b416-e2eff6cdc5a7/volumes"
Oct 30 14:28:31.618378 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:28:31.618299    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:28:46.777880 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:28:46.777851    4538 scope.go:122] "RemoveContainer" containerID="67c6b5af23aed9531a17853a883df2ba1dc9eb59c08ae4ad44ac58c72c3c43f9"
Oct 30 14:29:01.622815 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:29:01.622774    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:29:31.618720 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:29:31.618687    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:29:46.839875 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:29:46.839843    4538 scope.go:122] "RemoveContainer" containerID="bcd22247ae621a2d7aa25f3cd8ec9d5a19ae738a50775349c023ea57425d5593"
Oct 30 14:30:01.619447 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:30:01.619362    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:30:02.032979 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:30:02.032898    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"]
Oct 30 14:30:02.045376 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:30:02.045345    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dce4e691-crxn8"]
Oct 30 14:30:02.581089 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:30:02.581056    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b40df1cd-eba4-47d1-a08e-a720d40b7d57" path="/var/lib/kubelet/pods/b40df1cd-eba4-47d1-a08e-a720d40b7d57/volumes"
Oct 30 14:30:31.618260 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:30:31.618208    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:30:33.035521 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:30:33.035479    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"]
Oct 30 14:30:33.047733 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:30:33.047707    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-02dbe498-4tqcc"]
Oct 30 14:30:34.581622 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:30:34.581583    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e" path="/var/lib/kubelet/pods/b8c8ce2a-8c95-41e2-b62b-b86c69b8c16e/volumes"
Oct 30 14:31:01.621465 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:31:01.621427    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:31:03.030187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:03.030151    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"]
Oct 30 14:31:03.042694 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:03.042665    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c0b2e1d-dlr9f"]
Oct 30 14:31:04.580796 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:04.580762    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db69ea2b-8e84-4aa5-b523-dc69b18fa006" path="/var/lib/kubelet/pods/db69ea2b-8e84-4aa5-b523-dc69b18fa006/volumes"
Oct 30 14:31:08.033832 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:08.033798    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"]
Oct 30 14:31:08.046381 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:08.046353    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b0e6b7a2-vj8kl"]
Oct 30 14:31:08.581365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:08.581327    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41a10681-13c3-49d3-9902-b23a1f1f882b" path="/var/lib/kubelet/pods/41a10681-13c3-49d3-9902-b23a1f1f882b/volumes"
Oct 30 14:31:31.618765 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:31:31.618680    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:31:46.865262 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:46.865232    4538 scope.go:122] "RemoveContainer" containerID="7e5d18eb1c3cf826c876e6d9bbfe5abb8238249016e586d0b6e429049c7c51c5"
Oct 30 14:31:46.873127 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:31:46.873111    4538 scope.go:122] "RemoveContainer" containerID="a0612730cab15d27d355e947a6dfcb9c9a8c9067c123ddc2258bd94df475b16f"
Oct 30 14:32:01.617856 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:32:01.617819    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:32:23.042270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:32:23.036900    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"]
Oct 30 14:32:23.047272 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:32:23.044399    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cddf4350-kf5mn"]
Oct 30 14:32:24.582670 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:32:24.582628    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf964cfd-fdba-4f16-862d-69985d3842a0" path="/var/lib/kubelet/pods/cf964cfd-fdba-4f16-862d-69985d3842a0/volumes"
Oct 30 14:32:31.618691 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:32:31.618651    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:32:46.894156 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:32:46.894121    4538 scope.go:122] "RemoveContainer" containerID="afe2e8fdcbdad48dbf18fb415c70386ef63e78d4cf5cda8893c0ccc3d493e763"
Oct 30 14:32:46.902237 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:32:46.902213    4538 scope.go:122] "RemoveContainer" containerID="ae0e5d0ce8021f242718d3de86e2a6487969cbff61e1c2106fa1ec7dd25832ff"
Oct 30 14:33:01.618088 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:33:01.618049    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:33:31.618916 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:33:31.618875    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:33:37.635946 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.635909    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"]
Oct 30 14:33:37.636551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636535    4538 cpu_manager.go:414] "containerMap: removing container" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerName="payload-pre-processing"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636554    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerName="payload-pre-processing"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636568    4538 cpu_manager.go:414] "containerMap: removing container" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636575    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636587    4538 cpu_manager.go:414] "containerMap: removing container" podUID="8654b836-bfeb-491b-9f86-efa646835c0b" containerName="main"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636595    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8654b836-bfeb-491b-9f86-efa646835c0b" containerName="main"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636607    4538 cpu_manager.go:414] "containerMap: removing container" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636615    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy"
Oct 30 14:33:37.636631 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636630    4538 cpu_manager.go:414] "containerMap: removing container" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636638    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636656    4538 cpu_manager.go:414] "containerMap: removing container" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerName="payload-processing"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636664    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerName="payload-processing"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636683    4538 cpu_manager.go:414] "containerMap: removing container" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerName="payload-processing"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636691    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerName="payload-processing"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636700    4538 cpu_manager.go:414] "containerMap: removing container" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636708    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636721    4538 cpu_manager.go:414] "containerMap: removing container" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636728    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636745    4538 cpu_manager.go:414] "containerMap: removing container" podUID="ca3d6438-3eaf-479e-b272-59d0e7704662" containerName="maas-api"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636752    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca3d6438-3eaf-479e-b272-59d0e7704662" containerName="maas-api"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636771    4538 cpu_manager.go:414] "containerMap: removing container" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636778    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636788    4538 cpu_manager.go:414] "containerMap: removing container" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636795    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636895    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="31a86e21-1d17-4d0b-8e73-0d3afaead401" containerName="payload-processing"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636908    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5108307-a4ff-4100-96c4-71d1746a2541" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636918    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9c7a116-6df2-453c-ae8d-6783153dc4f6" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636928    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca3d6438-3eaf-479e-b272-59d0e7704662" containerName="maas-api"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636939    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="d98bcd5b-61d8-4e78-92f1-f08f63e76f2c" containerName="main"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636947    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ff8fbdb-84f8-4c46-9f34-ff508b8b008f" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636957    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="c334095f-eacd-42a2-ba0b-a6f819fd45f2" containerName="payload-pre-processing"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636966    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="8af36ee1-3a0d-4165-a048-0b4be7219f4f" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636975    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="8654b836-bfeb-491b-9f86-efa646835c0b" containerName="main"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636984    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="8cbff1e9-af51-4db0-a38f-8209608273da" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.636993    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="e97236a8-038b-46a7-b416-e2eff6cdc5a7" containerName="istio-proxy"
Oct 30 14:33:37.637033 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.637003    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="06de232b-9dbe-4144-abde-db72a2bddbf5" containerName="payload-processing"
Oct 30 14:33:37.640566 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.640540    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.669541 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.669490    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-2c6211\"/\"kube-root-ca.crt\""
Oct 30 14:33:37.669541 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.669490    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-2c6211\"/\"simulator-single-main-2c6211-kserve-self-signed-certs\""
Oct 30 14:33:37.669541 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.669490    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-2c6211\"/\"openshift-service-ca.crt\""
Oct 30 14:33:37.669761 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.669574    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-2c6211\"/\"default-dockercfg-d4l92\""
Oct 30 14:33:37.672014 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.671988    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"]
Oct 30 14:33:37.751801 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.751757    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-748bx\" (UniqueName: \"kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.751975 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.751817    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.752017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.751978    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.752017 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.752005    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.752093 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.752079    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.752128 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.752101    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.853562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.853525    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.853562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.853561    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.853829 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.853596    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.853829 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.853612    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.853829 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.853635    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-748bx\" (UniqueName: \"kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.853829 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.853656    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.854078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.854018    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.854078 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.854047    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.854149 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.854092    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.856018 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.855994    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.856193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.856175    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.878152 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.878131    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-748bx\" (UniqueName: \"kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx\") pod \"simulator-single-main-2c6211-kserve-fc4445495-w4h2p\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") " pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:37.964855 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:37.964762    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:38.265182 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:38.265104    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"]
Oct 30 14:33:38.269047 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:33:38.269015    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c8ce76c_707c_4913_9fa0_ea4c4dd7684d.slice/crio-265e9e0ea05ae8acdddb5f37e78e18b23ab2fca158b23b2bf5e71214d4f9d209 WatchSource:0}: Error finding container 265e9e0ea05ae8acdddb5f37e78e18b23ab2fca158b23b2bf5e71214d4f9d209: Status 404 returned error can't find the container with id 265e9e0ea05ae8acdddb5f37e78e18b23ab2fca158b23b2bf5e71214d4f9d209
Oct 30 14:33:38.280527 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:38.280500    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p" event={"ID":"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d","Type":"ContainerStarted","Data":"265e9e0ea05ae8acdddb5f37e78e18b23ab2fca158b23b2bf5e71214d4f9d209"}
Oct 30 14:33:39.286548 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:39.286515    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p" event={"ID":"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d","Type":"ContainerStarted","Data":"2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b"}
Oct 30 14:33:39.332012 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:39.331946    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p" podStartSLOduration=2.331929676 podStartE2EDuration="2.331929676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:33:39.331186757 +0000 UTC m=+1612.966133377" watchObservedRunningTime="2026-10-30 14:33:39.331929676 +0000 UTC m=+1612.966876299"
Oct 30 14:33:39.965480 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:39.965448    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:46.923083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:46.923053    4538 scope.go:122] "RemoveContainer" containerID="eec499359a14eaeffa10b098d28f366ee96d6a92d55fbfb66532aeaa257f0d24"
Oct 30 14:33:47.965818 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:47.965781    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:47.978271 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:47.978219    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:33:48.337320 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:33:48.337298    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:34:01.620727 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:34:01.620686    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:34:17.577562 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:17.577527    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"]
Oct 30 14:34:31.619062 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:34:31.618976    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:34:32.597157 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.597114    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p" podUID="2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" containerName="main" containerID="cri-o://2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b" gracePeriod=45
Oct 30 14:34:32.844169 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.844143    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:34:32.934401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934319    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir\") pod \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") "
Oct 30 14:34:32.934401 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934370    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm\") pod \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") "
Oct 30 14:34:32.934621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934411    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx\" (UniqueName: \"kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx\") pod \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") "
Oct 30 14:34:32.934621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934478    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs\") pod \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") "
Oct 30 14:34:32.934621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934561    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home\") pod \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") "
Oct 30 14:34:32.934621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934569    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir" pod "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" (UID: "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:34:32.934621 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934598    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache\") pod \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\" (UID: \"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d\") "
Oct 30 14:34:32.934860 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934809    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache" pod "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" (UID: "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:34:32.934944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934910    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home" pod "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" (UID: "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:34:32.934996 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934979    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:34:32.935045 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.934998    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:34:32.936767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.936726    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx" pod "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" (UID: "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d"). InnerVolumeSpecName "kube-api-access-748bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:34:32.936961 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.936941    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm" pod "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" (UID: "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:34:32.937028 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:32.936958    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs" pod "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" (UID: "2c8ce76c-707c-4913-9fa0-ea4c4dd7684d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:34:33.036197 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.036160    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:34:33.036197 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.036189    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:34:33.036197 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.036200    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-748bx\" (UniqueName: \"kubernetes.io/projected/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-kube-api-access-748bx\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:34:33.036464 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.036210    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:34:33.536075 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.536034    4538 generic.go:356] "Generic (PLEG): container finished" podID="2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" containerID="2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b" exitCode=0
Oct 30 14:34:33.536298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.536085    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"
Oct 30 14:34:33.536298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.536120    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p" event={"ID":"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d","Type":"ContainerDied","Data":"2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b"}
Oct 30 14:34:33.536298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.536162    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p" event={"ID":"2c8ce76c-707c-4913-9fa0-ea4c4dd7684d","Type":"ContainerDied","Data":"265e9e0ea05ae8acdddb5f37e78e18b23ab2fca158b23b2bf5e71214d4f9d209"}
Oct 30 14:34:33.536298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.536182    4538 scope.go:122] "RemoveContainer" containerID="2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b"
Oct 30 14:34:33.545122 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.545104    4538 scope.go:122] "RemoveContainer" containerID="2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b"
Oct 30 14:34:33.545469 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:34:33.545450    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b\": container with ID starting with 2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b not found: ID does not exist" containerID="2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b"
Oct 30 14:34:33.545539 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.545480    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b"} err="failed to get container status \"2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b\": rpc error: code = NotFound desc = could not find container \"2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b\": container with ID starting with 2d2c8f28602b90e8f17200dfe8dc6f7d89c50fe0672bf648b9fbe8a69e896b8b not found: ID does not exist"
Oct 30 14:34:33.590688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.590663    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"]
Oct 30 14:34:33.602927 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:33.602904    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-2c6211/simulator-single-main-2c6211-kserve-fc4445495-w4h2p"]
Oct 30 14:34:34.580857 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:34.580818    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" path="/var/lib/kubelet/pods/2c8ce76c-707c-4913-9fa0-ea4c4dd7684d/volumes"
Oct 30 14:34:46.944316 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:34:46.944281    4538 scope.go:122] "RemoveContainer" containerID="da062903541dbaf32c6dfd5fd2623822295ecc844d82e5654bb45f9cd52957b7"
Oct 30 14:35:01.619386 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:35:01.619350    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:35:31.619060 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:35:31.619022    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:36:01.618527 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:36:01.618447    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:36:31.618524 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:36:31.618485    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:37:01.622087 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:37:01.622041    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:37:09.534847 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.534805    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"]
Oct 30 14:37:09.535423 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.535402    4538 cpu_manager.go:414] "containerMap: removing container" podUID="2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" containerName="main"
Oct 30 14:37:09.535516 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.535424    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" containerName="main"
Oct 30 14:37:09.535575 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.535515    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c8ce76c-707c-4913-9fa0-ea4c4dd7684d" containerName="main"
Oct 30 14:37:09.540425 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.540395    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.570285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.570257    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-e8c73c\"/\"kube-root-ca.crt\""
Oct 30 14:37:09.570285 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.570278    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-e8c73c\"/\"default-dockercfg-vnndk\""
Oct 30 14:37:09.570634 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.570614    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-e8c73c\"/\"openshift-service-ca.crt\""
Oct 30 14:37:09.570739 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.570717    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-e8c73c\"/\"simulator-single-main-e8c73c-kserve-self-signed-certs\""
Oct 30 14:37:09.571846 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.571824    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"]
Oct 30 14:37:09.675663 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.675626    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.675842 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.675679    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.675907 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.675837    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.675982 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.675965    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.676043 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.676019    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.676098 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.676053    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxgj\" (UniqueName: \"kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.776741 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.776705    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.776926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.776769    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.776926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.776802    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxgj\" (UniqueName: \"kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.776926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.776841    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.776926 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.776880    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.777158 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.776931    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.777212 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.777172    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.777328 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.777299    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.777485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.777456    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.789332 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.783767    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.789332 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.784027    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.801528 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.801494    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxgj\" (UniqueName: \"kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj\") pod \"simulator-single-main-e8c73c-kserve-7977df687-ljmgs\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") " pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:09.866055 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:09.866023    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:10.164207 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:10.164173    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"]
Oct 30 14:37:10.168060 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:37:10.168031    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c9f3c9f_372c_449b_9f13_676e014ff21c.slice/crio-afc1373b30c59b8a67acfdd2bfedcff19ef03b1bbce1ebbe9df16cb05fd615c5 WatchSource:0}: Error finding container afc1373b30c59b8a67acfdd2bfedcff19ef03b1bbce1ebbe9df16cb05fd615c5: Status 404 returned error can't find the container with id afc1373b30c59b8a67acfdd2bfedcff19ef03b1bbce1ebbe9df16cb05fd615c5
Oct 30 14:37:10.224564 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:10.224539    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs" event={"ID":"9c9f3c9f-372c-449b-9f13-676e014ff21c","Type":"ContainerStarted","Data":"2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db"}
Oct 30 14:37:10.224655 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:10.224574    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs" event={"ID":"9c9f3c9f-372c-449b-9f13-676e014ff21c","Type":"ContainerStarted","Data":"afc1373b30c59b8a67acfdd2bfedcff19ef03b1bbce1ebbe9df16cb05fd615c5"}
Oct 30 14:37:10.268949 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:10.268903    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs" podStartSLOduration=1.268888741 podStartE2EDuration="1.268888741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:37:10.267827598 +0000 UTC m=+1823.902774219" watchObservedRunningTime="2026-10-30 14:37:10.268888741 +0000 UTC m=+1823.903835406"
Oct 30 14:37:10.866652 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:10.866613    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:19.866391 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:19.866355    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:19.879233 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:19.879211    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:20.284906 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:20.284828    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:31.619075 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:37:31.618993    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:37:42.821309 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:42.821273    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"]
Oct 30 14:37:57.841036 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:57.840995    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs" podUID="9c9f3c9f-372c-449b-9f13-676e014ff21c" containerName="main" containerID="cri-o://2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db" gracePeriod=45
Oct 30 14:37:58.103346 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.103295    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:58.205951 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.205923    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir\") pod \"9c9f3c9f-372c-449b-9f13-676e014ff21c\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") "
Oct 30 14:37:58.206121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.205963    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache\") pod \"9c9f3c9f-372c-449b-9f13-676e014ff21c\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") "
Oct 30 14:37:58.206121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206021    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home\") pod \"9c9f3c9f-372c-449b-9f13-676e014ff21c\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") "
Oct 30 14:37:58.206121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206065    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs\") pod \"9c9f3c9f-372c-449b-9f13-676e014ff21c\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") "
Oct 30 14:37:58.206121 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206109    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm\") pod \"9c9f3c9f-372c-449b-9f13-676e014ff21c\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") "
Oct 30 14:37:58.206362 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206146    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj\" (UniqueName: \"kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj\") pod \"9c9f3c9f-372c-449b-9f13-676e014ff21c\" (UID: \"9c9f3c9f-372c-449b-9f13-676e014ff21c\") "
Oct 30 14:37:58.206362 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206242    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache" pod "9c9f3c9f-372c-449b-9f13-676e014ff21c" (UID: "9c9f3c9f-372c-449b-9f13-676e014ff21c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:37:58.206362 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206230    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir" pod "9c9f3c9f-372c-449b-9f13-676e014ff21c" (UID: "9c9f3c9f-372c-449b-9f13-676e014ff21c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:37:58.206362 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206323    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home" pod "9c9f3c9f-372c-449b-9f13-676e014ff21c" (UID: "9c9f3c9f-372c-449b-9f13-676e014ff21c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:37:58.206578 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206560    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:37:58.206630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206583    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:37:58.206630 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.206596    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:37:58.208365 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.208336    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj" pod "9c9f3c9f-372c-449b-9f13-676e014ff21c" (UID: "9c9f3c9f-372c-449b-9f13-676e014ff21c"). InnerVolumeSpecName "kube-api-access-mmxgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:37:58.208668 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.208648    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm" pod "9c9f3c9f-372c-449b-9f13-676e014ff21c" (UID: "9c9f3c9f-372c-449b-9f13-676e014ff21c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:37:58.208752 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.208651    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs" pod "9c9f3c9f-372c-449b-9f13-676e014ff21c" (UID: "9c9f3c9f-372c-449b-9f13-676e014ff21c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:37:58.307843 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.307814    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c9f3c9f-372c-449b-9f13-676e014ff21c-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:37:58.307843 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.307838    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c9f3c9f-372c-449b-9f13-676e014ff21c-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:37:58.307843 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.307848    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmxgj\" (UniqueName: \"kubernetes.io/projected/9c9f3c9f-372c-449b-9f13-676e014ff21c-kube-api-access-mmxgj\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:37:58.443602 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.443518    4538 generic.go:356] "Generic (PLEG): container finished" podID="9c9f3c9f-372c-449b-9f13-676e014ff21c" containerID="2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db" exitCode=0
Oct 30 14:37:58.443602 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.443560    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"
Oct 30 14:37:58.443602 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.443585    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs" event={"ID":"9c9f3c9f-372c-449b-9f13-676e014ff21c","Type":"ContainerDied","Data":"2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db"}
Oct 30 14:37:58.443846 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.443625    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs" event={"ID":"9c9f3c9f-372c-449b-9f13-676e014ff21c","Type":"ContainerDied","Data":"afc1373b30c59b8a67acfdd2bfedcff19ef03b1bbce1ebbe9df16cb05fd615c5"}
Oct 30 14:37:58.443846 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.443647    4538 scope.go:122] "RemoveContainer" containerID="2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db"
Oct 30 14:37:58.452812 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.452791    4538 scope.go:122] "RemoveContainer" containerID="2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db"
Oct 30 14:37:58.453083 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:37:58.453062    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db\": container with ID starting with 2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db not found: ID does not exist" containerID="2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db"
Oct 30 14:37:58.453144 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.453093    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db"} err="failed to get container status \"2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db\": rpc error: code = NotFound desc = could not find container \"2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db\": container with ID starting with 2c23c3f05a2b8d37aee24f48d926aba3ff6542a95ee5bfbd9a5f7076a207d0db not found: ID does not exist"
Oct 30 14:37:58.499257 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.499224    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"]
Oct 30 14:37:58.511702 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.511680    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-e8c73c/simulator-single-main-e8c73c-kserve-7977df687-ljmgs"]
Oct 30 14:37:58.580967 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:37:58.580941    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c9f3c9f-372c-449b-9f13-676e014ff21c" path="/var/lib/kubelet/pods/9c9f3c9f-372c-449b-9f13-676e014ff21c/volumes"
Oct 30 14:38:01.619229 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:38:01.619193    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:38:19.111406 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.111366    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"]
Oct 30 14:38:19.112022 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.111912    4538 cpu_manager.go:414] "containerMap: removing container" podUID="9c9f3c9f-372c-449b-9f13-676e014ff21c" containerName="main"
Oct 30 14:38:19.112022 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.111931    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c9f3c9f-372c-449b-9f13-676e014ff21c" containerName="main"
Oct 30 14:38:19.112145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.112052    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c9f3c9f-372c-449b-9f13-676e014ff21c" containerName="main"
Oct 30 14:38:19.115085 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.115063    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.137646 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.137600    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"]
Oct 30 14:38:19.145055 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.145029    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-daa9ce43-kserve-self-signed-certs\""
Oct 30 14:38:19.145055 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.145046    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 14:38:19.145204 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.145167    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-btpq5\""
Oct 30 14:38:19.145305 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.145285    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 14:38:19.203604 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.203576    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.203767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.203612    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.203767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.203643    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.203767 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.203750    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.203914 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.203866    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.203914 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.203897    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8269p\" (UniqueName: \"kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.304620 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.304584    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.304620 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.304620    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.304797 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.304701    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.304844 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.304823    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8269p\" (UniqueName: \"kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.304892 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.304882    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.304947 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.304921    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.305053 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.305030    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.305116 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.305084    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.305234 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.305220    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.306959 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.306935    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.307219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.307201    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.329902 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.329867    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8269p\" (UniqueName: \"kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p\") pod \"e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") " pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.439632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.439548    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:19.736011 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:19.735917    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"]
Oct 30 14:38:19.739777 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:38:19.739747    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae6daf71_cbbd_4980_b8fc_342f55f110e7.slice/crio-eeea55c1b7d9e52518973ee6bf9fcdd92151af2fdcd838a985028e0afef7d82a WatchSource:0}: Error finding container eeea55c1b7d9e52518973ee6bf9fcdd92151af2fdcd838a985028e0afef7d82a: Status 404 returned error can't find the container with id eeea55c1b7d9e52518973ee6bf9fcdd92151af2fdcd838a985028e0afef7d82a
Oct 30 14:38:20.550180 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:20.550142    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8" event={"ID":"ae6daf71-cbbd-4980-b8fc-342f55f110e7","Type":"ContainerStarted","Data":"271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6"}
Oct 30 14:38:20.550180 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:20.550184    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8" event={"ID":"ae6daf71-cbbd-4980-b8fc-342f55f110e7","Type":"ContainerStarted","Data":"eeea55c1b7d9e52518973ee6bf9fcdd92151af2fdcd838a985028e0afef7d82a"}
Oct 30 14:38:20.595944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:20.595884    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8" podStartSLOduration=1.59587072 podStartE2EDuration="1.59587072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:38:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:38:20.594402693 +0000 UTC m=+1894.229349313" watchObservedRunningTime="2026-10-30 14:38:20.59587072 +0000 UTC m=+1894.230817369"
Oct 30 14:38:21.440338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:21.440300    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:25.459269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:25.458344    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 14:38:25.459269 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:25.458425    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:38:29.439942 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:29.439910    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:29.452728 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:29.452704    4538 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:29.633675 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:29.633651    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:38:31.619065 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:38:31.618969    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:38:40.462270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:40.457341    4538 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 14:38:40.462270 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:40.457411    4538 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-fkwsg" podUID="54a14e56-a813-4999-a1a3-c10fa3099a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 14:38:54.007394 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:38:54.007362    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"]
Oct 30 14:39:01.622397 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:39:01.622321    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:39:09.104443 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.104403    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8" podUID="ae6daf71-cbbd-4980-b8fc-342f55f110e7" containerName="main" containerID="cri-o://271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6" gracePeriod=45
Oct 30 14:39:09.354145 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.354122    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:39:09.493115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493025    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache\") pod \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") "
Oct 30 14:39:09.493115 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493092    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs\") pod \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") "
Oct 30 14:39:09.493378 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493126    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p\" (UniqueName: \"kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p\") pod \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") "
Oct 30 14:39:09.493378 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493182    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir\") pod \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") "
Oct 30 14:39:09.493378 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493222    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm\") pod \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") "
Oct 30 14:39:09.493378 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493320    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home\") pod \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\" (UID: \"ae6daf71-cbbd-4980-b8fc-342f55f110e7\") "
Oct 30 14:39:09.493688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493315    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache" pod "ae6daf71-cbbd-4980-b8fc-342f55f110e7" (UID: "ae6daf71-cbbd-4980-b8fc-342f55f110e7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:39:09.493688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493524    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home" pod "ae6daf71-cbbd-4980-b8fc-342f55f110e7" (UID: "ae6daf71-cbbd-4980-b8fc-342f55f110e7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:39:09.493688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.493538    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir" pod "ae6daf71-cbbd-4980-b8fc-342f55f110e7" (UID: "ae6daf71-cbbd-4980-b8fc-342f55f110e7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:39:09.495544 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.495513    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm" pod "ae6daf71-cbbd-4980-b8fc-342f55f110e7" (UID: "ae6daf71-cbbd-4980-b8fc-342f55f110e7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 14:39:09.495659 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.495553    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p" pod "ae6daf71-cbbd-4980-b8fc-342f55f110e7" (UID: "ae6daf71-cbbd-4980-b8fc-342f55f110e7"). InnerVolumeSpecName "kube-api-access-8269p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:39:09.495659 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.495560    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs" pod "ae6daf71-cbbd-4980-b8fc-342f55f110e7" (UID: "ae6daf71-cbbd-4980-b8fc-342f55f110e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:39:09.594708 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.594675    4538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tmp-dir\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:09.594708 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.594701    4538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-dshm\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:09.594708 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.594709    4538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-home\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:09.594708 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.594717    4538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae6daf71-cbbd-4980-b8fc-342f55f110e7-model-cache\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:09.594984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.594724    4538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6daf71-cbbd-4980-b8fc-342f55f110e7-tls-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:09.594984 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.594733    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8269p\" (UniqueName: \"kubernetes.io/projected/ae6daf71-cbbd-4980-b8fc-342f55f110e7-kube-api-access-8269p\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:09.878775 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.878736    4538 generic.go:356] "Generic (PLEG): container finished" podID="ae6daf71-cbbd-4980-b8fc-342f55f110e7" containerID="271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6" exitCode=0
Oct 30 14:39:09.878944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.878780    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"
Oct 30 14:39:09.878944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.878790    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8" event={"ID":"ae6daf71-cbbd-4980-b8fc-342f55f110e7","Type":"ContainerDied","Data":"271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6"}
Oct 30 14:39:09.878944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.878906    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8" event={"ID":"ae6daf71-cbbd-4980-b8fc-342f55f110e7","Type":"ContainerDied","Data":"eeea55c1b7d9e52518973ee6bf9fcdd92151af2fdcd838a985028e0afef7d82a"}
Oct 30 14:39:09.878944 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.878931    4538 scope.go:122] "RemoveContainer" containerID="271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6"
Oct 30 14:39:09.888450 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.888431    4538 scope.go:122] "RemoveContainer" containerID="271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6"
Oct 30 14:39:09.888793 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:39:09.888773    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6\": container with ID starting with 271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6 not found: ID does not exist" containerID="271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6"
Oct 30 14:39:09.888873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.888800    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6"} err="failed to get container status \"271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6\": rpc error: code = NotFound desc = could not find container \"271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6\": container with ID starting with 271541dcb52161e8b36a0fa6b5b14bb895ad562afa88d28e33a746595fe3beb6 not found: ID does not exist"
Oct 30 14:39:09.933395 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.933357    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"]
Oct 30 14:39:09.935563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:09.935537    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-daa9ce43-kserve-54ffb49d77-vlzx8"]
Oct 30 14:39:10.581485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:10.581451    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae6daf71-cbbd-4980-b8fc-342f55f110e7" path="/var/lib/kubelet/pods/ae6daf71-cbbd-4980-b8fc-342f55f110e7/volumes"
Oct 30 14:39:31.618524 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:39:31.618476    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:39:33.910193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.910165    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"]
Oct 30 14:39:33.910605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.910584    4538 cpu_manager.go:414] "containerMap: removing container" podUID="ae6daf71-cbbd-4980-b8fc-342f55f110e7" containerName="main"
Oct 30 14:39:33.910605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.910602    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae6daf71-cbbd-4980-b8fc-342f55f110e7" containerName="main"
Oct 30 14:39:33.910688 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.910673    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae6daf71-cbbd-4980-b8fc-342f55f110e7" containerName="main"
Oct 30 14:39:33.915519 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.915500    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:33.933417 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.933374    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 14:39:33.946423 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.946390    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bm7kg\""
Oct 30 14:39:33.946573 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.946409    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 14:39:33.946661 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.946483    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 14:39:33.951825 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:33.951792    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"]
Oct 30 14:39:34.033106 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.033070    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 14:39:34.047385 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.047358    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.047551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.047397    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.047551 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.047507    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgsg\" (UniqueName: \"kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.047679 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.047557    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.148769 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.148728    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.148917 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.148839    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgsg\" (UniqueName: \"kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.148917 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.148878    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.149009 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.148944    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.149617 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.149591    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.151290 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.151263    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.151442 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.151420    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.173327 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.173275    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgsg\" (UniqueName: \"kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg\") pod \"maas-api-5c48877c75-ssl6l\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.233298 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.233273    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:34.539232 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.539145    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"]
Oct 30 14:39:34.543109 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:39:34.543081    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f46ad78_9853_453a_b204_cfdeffa9424c.slice/crio-5fdafae0e0e2bd8901e465f870c2d3ec58f57cf9587481fa7cde39a42bf56f1c WatchSource:0}: Error finding container 5fdafae0e0e2bd8901e465f870c2d3ec58f57cf9587481fa7cde39a42bf56f1c: Status 404 returned error can't find the container with id 5fdafae0e0e2bd8901e465f870c2d3ec58f57cf9587481fa7cde39a42bf56f1c
Oct 30 14:39:34.544468 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.544451    4538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 14:39:34.997299 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.997266    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l" event={"ID":"4f46ad78-9853-453a-b204-cfdeffa9424c","Type":"ContainerStarted","Data":"174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343"}
Oct 30 14:39:34.997651 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.997319    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l" event={"ID":"4f46ad78-9853-453a-b204-cfdeffa9424c","Type":"ContainerStarted","Data":"5fdafae0e0e2bd8901e465f870c2d3ec58f57cf9587481fa7cde39a42bf56f1c"}
Oct 30 14:39:34.997651 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:34.997383    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:35.043081 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:35.043042    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l" podStartSLOduration=1.7047536349999999 podStartE2EDuration="2.043028821s" totalImagesPullingTime="338.275186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:39:35.042206164 +0000 UTC m=+1968.677152785" watchObservedRunningTime="2026-10-30 14:39:35.043028821 +0000 UTC m=+1968.677975440"
Oct 30 14:39:41.007060 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.007031    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:41.493071 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.493039    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"]
Oct 30 14:39:41.509099 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.509064    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.519180 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.518779    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"]
Oct 30 14:39:41.616874 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.616845    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxvt\" (UniqueName: \"kubernetes.io/projected/aecfa8f0-95c6-4039-a3ab-4d8952b14628-kube-api-access-bnxvt\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.617034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.616878    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aecfa8f0-95c6-4039-a3ab-4d8952b14628-metrics-certs\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.617034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.616987    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aecfa8f0-95c6-4039-a3ab-4d8952b14628-maas-api-tls\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.617034 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.617014    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecfa8f0-95c6-4039-a3ab-4d8952b14628-openshift-service-ca\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.717770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.717739    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxvt\" (UniqueName: \"kubernetes.io/projected/aecfa8f0-95c6-4039-a3ab-4d8952b14628-kube-api-access-bnxvt\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.717770 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.717771    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aecfa8f0-95c6-4039-a3ab-4d8952b14628-metrics-certs\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.718015 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.717810    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aecfa8f0-95c6-4039-a3ab-4d8952b14628-maas-api-tls\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.718015 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.717826    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecfa8f0-95c6-4039-a3ab-4d8952b14628-openshift-service-ca\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.718481 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.718462    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aecfa8f0-95c6-4039-a3ab-4d8952b14628-openshift-service-ca\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.720194 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.720166    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aecfa8f0-95c6-4039-a3ab-4d8952b14628-maas-api-tls\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.720342 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.720319    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aecfa8f0-95c6-4039-a3ab-4d8952b14628-metrics-certs\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.742774 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.742750    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxvt\" (UniqueName: \"kubernetes.io/projected/aecfa8f0-95c6-4039-a3ab-4d8952b14628-kube-api-access-bnxvt\") pod \"maas-api-595cc648c-qwnrz\" (UID: \"aecfa8f0-95c6-4039-a3ab-4d8952b14628\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:41.827063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:41.827006    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:42.128241 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:42.128211    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"]
Oct 30 14:39:42.131845 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:39:42.131819    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecfa8f0_95c6_4039_a3ab_4d8952b14628.slice/crio-a809da941101e69b0ffee21dff0945bf7087c3fd0a96d2c25d0848b7961f8d36 WatchSource:0}: Error finding container a809da941101e69b0ffee21dff0945bf7087c3fd0a96d2c25d0848b7961f8d36: Status 404 returned error can't find the container with id a809da941101e69b0ffee21dff0945bf7087c3fd0a96d2c25d0848b7961f8d36
Oct 30 14:39:43.032676 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:43.032639    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz" event={"ID":"aecfa8f0-95c6-4039-a3ab-4d8952b14628","Type":"ContainerStarted","Data":"7744ff0fbcb0498f4a2bd72292e642158887d6156676b3ded7bf84d83dbb2d95"}
Oct 30 14:39:43.032966 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:43.032945    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:43.033118 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:43.033094    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz" event={"ID":"aecfa8f0-95c6-4039-a3ab-4d8952b14628","Type":"ContainerStarted","Data":"a809da941101e69b0ffee21dff0945bf7087c3fd0a96d2c25d0848b7961f8d36"}
Oct 30 14:39:43.080924 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:43.080869    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz" podStartSLOduration=1.648132707 podStartE2EDuration="2.08085133s" totalImagesPullingTime="432.718623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:39:43.080448769 +0000 UTC m=+1976.715395394" watchObservedRunningTime="2026-10-30 14:39:43.08085133 +0000 UTC m=+1976.715797951"
Oct 30 14:39:49.059408 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.059378    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-qwnrz"
Oct 30 14:39:49.137998 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.137969    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"]
Oct 30 14:39:49.138206 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.138184    4538 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l" podUID="4f46ad78-9853-453a-b204-cfdeffa9424c" containerName="maas-api" containerID="cri-o://174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343" gracePeriod=30
Oct 30 14:39:49.393961 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.393934    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:49.528909 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.528877    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs\") pod \"4f46ad78-9853-453a-b204-cfdeffa9424c\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") "
Oct 30 14:39:49.529097 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.528920    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg\" (UniqueName: \"kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg\") pod \"4f46ad78-9853-453a-b204-cfdeffa9424c\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") "
Oct 30 14:39:49.529097 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.528948    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls\") pod \"4f46ad78-9853-453a-b204-cfdeffa9424c\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") "
Oct 30 14:39:49.529097 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.529029    4538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca\") pod \"4f46ad78-9853-453a-b204-cfdeffa9424c\" (UID: \"4f46ad78-9853-453a-b204-cfdeffa9424c\") "
Oct 30 14:39:49.529472 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.529437    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca" pod "4f46ad78-9853-453a-b204-cfdeffa9424c" (UID: "4f46ad78-9853-453a-b204-cfdeffa9424c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 14:39:49.530976 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.530942    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg" pod "4f46ad78-9853-453a-b204-cfdeffa9424c" (UID: "4f46ad78-9853-453a-b204-cfdeffa9424c"). InnerVolumeSpecName "kube-api-access-9bgsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 14:39:49.531092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.530997    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs" pod "4f46ad78-9853-453a-b204-cfdeffa9424c" (UID: "4f46ad78-9853-453a-b204-cfdeffa9424c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:39:49.531092 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.531022    4538 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls" pod "4f46ad78-9853-453a-b204-cfdeffa9424c" (UID: "4f46ad78-9853-453a-b204-cfdeffa9424c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 14:39:49.630063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.629981    4538 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-metrics-certs\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:49.630063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.630008    4538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bgsg\" (UniqueName: \"kubernetes.io/projected/4f46ad78-9853-453a-b204-cfdeffa9424c-kube-api-access-9bgsg\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:49.630063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.630018    4538 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f46ad78-9853-453a-b204-cfdeffa9424c-maas-api-tls\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:49.630063 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:49.630028    4538 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f46ad78-9853-453a-b204-cfdeffa9424c-openshift-service-ca\") on node \"ip-10-0-132-7.ec2.internal\" DevicePath \"\""
Oct 30 14:39:50.084061 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.084030    4538 generic.go:356] "Generic (PLEG): container finished" podID="4f46ad78-9853-453a-b204-cfdeffa9424c" containerID="174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343" exitCode=0
Oct 30 14:39:50.084493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.084078    4538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"
Oct 30 14:39:50.084493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.084085    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l" event={"ID":"4f46ad78-9853-453a-b204-cfdeffa9424c","Type":"ContainerDied","Data":"174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343"}
Oct 30 14:39:50.084493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.084128    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l" event={"ID":"4f46ad78-9853-453a-b204-cfdeffa9424c","Type":"ContainerDied","Data":"5fdafae0e0e2bd8901e465f870c2d3ec58f57cf9587481fa7cde39a42bf56f1c"}
Oct 30 14:39:50.084493 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.084148    4538 scope.go:122] "RemoveContainer" containerID="174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343"
Oct 30 14:39:50.093541 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.093524    4538 scope.go:122] "RemoveContainer" containerID="174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343"
Oct 30 14:39:50.093771 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:39:50.093751    4538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343\": container with ID starting with 174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343 not found: ID does not exist" containerID="174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343"
Oct 30 14:39:50.093810 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.093779    4538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343"} err="failed to get container status \"174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343\": rpc error: code = NotFound desc = could not find container \"174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343\": container with ID starting with 174ac17ad82855f42b06a73e299d0b8aae3a22fd4f2f35448c87d2e17f7de343 not found: ID does not exist"
Oct 30 14:39:50.137280 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.137237    4538 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"]
Oct 30 14:39:50.149971 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.149943    4538 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-ssl6l"]
Oct 30 14:39:50.585349 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:39:50.585319    4538 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f46ad78-9853-453a-b204-cfdeffa9424c" path="/var/lib/kubelet/pods/4f46ad78-9853-453a-b204-cfdeffa9424c/volumes"
Oct 30 14:40:01.619946 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:40:01.619906    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:40:31.619334 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:40:31.619258    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:40:43.024766 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:43.024738    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-sbm82_cb5a8af1-f7a1-4dbd-b618-242b3fce0509/manager/0.log"
Oct 30 14:40:43.519995 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:43.519962    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-xwt9p_57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a/manager/0.log"
Oct 30 14:40:44.067149 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:44.067122    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-prdsg_a4c0b636-c8f9-41c5-9dc2-09149172687b/server/0.log"
Oct 30 14:40:44.267945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:44.267917    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-sgfw5_813b27f2-67b6-4cde-b0cd-78c20ae36a3d/manager/0.log"
Oct 30 14:40:44.495129 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:44.495102    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-observability-584f99c788-rq544_4c4123f9-5539-4844-b796-1d270ae365a8/manager/0.log"
Oct 30 14:40:45.249538 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:45.249509    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-ncf7k_f4f605bf-761a-42a3-a87d-35aa1c8cbb81/copy-manifests/0.log"
Oct 30 14:40:45.285485 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:45.285459    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-ncf7k_f4f605bf-761a-42a3-a87d-35aa1c8cbb81/manager/0.log"
Oct 30 14:40:45.497338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:45.497314    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-cf4z9_87430a8a-1756-4d40-8f50-88f27a0d660f/proxy/0.log"
Oct 30 14:40:46.261605 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:46.261580    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-qwnrz_aecfa8f0-95c6-4039-a3ab-4d8952b14628/maas-api/0.log"
Oct 30 14:40:51.150715 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:51.150677    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-856dd584c5-9nm6p_b5563654-5419-449c-944b-48cd6a44f279/manager/0.log"
Oct 30 14:40:51.913639 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:51.913602    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-gh9bt_e25778f1-11cd-43ed-9432-7a7aa5256d06/istio-proxy/0.log"
Oct 30 14:40:52.903228 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:52.903192    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-fkwsg_54a14e56-a813-4999-a1a3-c10fa3099a41/istio-proxy/1.log"
Oct 30 14:40:53.090685 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:53.090654    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-l2258_57985a6e-e239-4297-a32f-f7fc2283fefd/istio-proxy/0.log"
Oct 30 14:40:53.692370 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:53.692346    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-svls9_670c8f63-b654-485f-a6d3-85113e8114d4/istio-proxy/0.log"
Oct 30 14:40:55.462026 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:40:55.461993    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-fkwsg_54a14e56-a813-4999-a1a3-c10fa3099a41/istio-proxy/0.log"
Oct 30 14:41:01.619338 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:41:01.619298    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:41:07.234945 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:07.234913    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-sbm82_cb5a8af1-f7a1-4dbd-b618-242b3fce0509/manager/0.log"
Oct 30 14:41:07.684287 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:07.684241    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-xwt9p_57c96af4-2913-4e9a-bfe8-bd6f20c5eb0a/manager/0.log"
Oct 30 14:41:08.193895 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:08.193867    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-prdsg_a4c0b636-c8f9-41c5-9dc2-09149172687b/server/0.log"
Oct 30 14:41:08.377219 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:08.377185    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-f87fcf56c-sgfw5_813b27f2-67b6-4cde-b0cd-78c20ae36a3d/manager/0.log"
Oct 30 14:41:08.574088 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:08.574011    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-observability-584f99c788-rq544_4c4123f9-5539-4844-b796-1d270ae365a8/manager/0.log"
Oct 30 14:41:09.289618 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:09.289586    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-ncf7k_f4f605bf-761a-42a3-a87d-35aa1c8cbb81/copy-manifests/0.log"
Oct 30 14:41:09.325917 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:09.325895    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-ncf7k_f4f605bf-761a-42a3-a87d-35aa1c8cbb81/manager/0.log"
Oct 30 14:41:09.543863 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:09.543768    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-cf4z9_87430a8a-1756-4d40-8f50-88f27a0d660f/proxy/0.log"
Oct 30 14:41:10.065925 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:10.065886    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-qwnrz_aecfa8f0-95c6-4039-a3ab-4d8952b14628/maas-api/0.log"
Oct 30 14:41:14.689379 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:14.689326    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-856dd584c5-9nm6p_b5563654-5419-449c-944b-48cd6a44f279/manager/0.log"
Oct 30 14:41:15.257057 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:15.257026    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-gh9bt_e25778f1-11cd-43ed-9432-7a7aa5256d06/istio-proxy/0.log"
Oct 30 14:41:16.260172 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:16.260138    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-fkwsg_54a14e56-a813-4999-a1a3-c10fa3099a41/istio-proxy/1.log"
Oct 30 14:41:16.457193 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:16.457167    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-l2258_57985a6e-e239-4297-a32f-f7fc2283fefd/istio-proxy/0.log"
Oct 30 14:41:17.072113 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:41:17.072085    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-svls9_670c8f63-b654-485f-a6d3-85113e8114d4/istio-proxy/0.log"
Oct 30 14:41:31.618525 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:41:31.618490    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:42:01.617911 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:42:01.617827    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:42:31.618935 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:42:31.618898    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:42:49.683111 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:49.683076    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vbbts_2a21de7b-d2bd-4174-aee2-047a16242992/global-pull-secret-syncer/0.log"
Oct 30 14:42:49.694303 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:49.694285    4538 ???:1] "http: TLS handshake error from 10.0.130.107:34260: EOF"
Oct 30 14:42:50.842808 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:50.842775    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g2tcs_4fbb0acc-a13c-4ca6-b00f-69e4c03eca15/konnectivity-agent/0.log"
Oct 30 14:42:51.430491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:51.430459    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-7.ec2.internal_01f7fab24259baa567abf70da12a1430/haproxy/0.log"
Oct 30 14:42:57.897095 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:57.897070    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-856dd584c5-9nm6p_b5563654-5419-449c-944b-48cd6a44f279/manager/0.log"
Oct 30 14:42:59.640338 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.640295    4538 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"]
Oct 30 14:42:59.640724 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.640684    4538 cpu_manager.go:414] "containerMap: removing container" podUID="4f46ad78-9853-453a-b204-cfdeffa9424c" containerName="maas-api"
Oct 30 14:42:59.640724 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.640695    4538 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f46ad78-9853-453a-b204-cfdeffa9424c" containerName="maas-api"
Oct 30 14:42:59.640795 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.640755    4538 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f46ad78-9853-453a-b204-cfdeffa9424c" containerName="maas-api"
Oct 30 14:42:59.643747 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.643732    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.662857 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.662827    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"]
Oct 30 14:42:59.673454 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.673433    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qw6xv\"/\"openshift-service-ca.crt\""
Oct 30 14:42:59.673563 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.673472    4538 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qw6xv\"/\"kube-root-ca.crt\""
Oct 30 14:42:59.673606 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.673573    4538 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qw6xv\"/\"default-dockercfg-vfvlx\""
Oct 30 14:42:59.685800 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.685770    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-lib-modules\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.685907 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.685833    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vlp\" (UniqueName: \"kubernetes.io/projected/ec42f568-24f7-4c63-9399-023ff9c1ded6-kube-api-access-78vlp\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.685952 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.685932    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-podres\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.686012 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.685993    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-sys\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.686187 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.686165    4538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-proc\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.786911 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.786882    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vlp\" (UniqueName: \"kubernetes.io/projected/ec42f568-24f7-4c63-9399-023ff9c1ded6-kube-api-access-78vlp\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.786923    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-podres\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.786941    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-sys\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.786974    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-proc\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.787014    4538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-lib-modules\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787083 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.787015    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-podres\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.787079    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-sys\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.787093    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-lib-modules\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.787313 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.787092    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec42f568-24f7-4c63-9399-023ff9c1ded6-proc\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.812039 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.812015    4538 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vlp\" (UniqueName: \"kubernetes.io/projected/ec42f568-24f7-4c63-9399-023ff9c1ded6-kube-api-access-78vlp\") pod \"perf-node-gather-daemonset-7tl66\" (UID: \"ec42f568-24f7-4c63-9399-023ff9c1ded6\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:42:59.957345 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:42:59.957228    4538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:43:00.254651 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:00.254537    4538 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"]
Oct 30 14:43:00.258580 ip-10-0-132-7 kubenswrapper[4538]: W1030 14:43:00.258548    4538 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podec42f568_24f7_4c63_9399_023ff9c1ded6.slice/crio-129f3d22842f8f5db03869910cdca21a749e9bc8bf38d82468fea796d3f04a72 WatchSource:0}: Error finding container 129f3d22842f8f5db03869910cdca21a749e9bc8bf38d82468fea796d3f04a72: Status 404 returned error can't find the container with id 129f3d22842f8f5db03869910cdca21a749e9bc8bf38d82468fea796d3f04a72
Oct 30 14:43:00.932317 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:00.932282    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66" event={"ID":"ec42f568-24f7-4c63-9399-023ff9c1ded6","Type":"ContainerStarted","Data":"999c28bb9ba50d02e370b9e0bfcdbebbfc2a722ca4539b8030a6eb1b5fe8832f"}
Oct 30 14:43:00.932712 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:00.932337    4538 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66" event={"ID":"ec42f568-24f7-4c63-9399-023ff9c1ded6","Type":"ContainerStarted","Data":"129f3d22842f8f5db03869910cdca21a749e9bc8bf38d82468fea796d3f04a72"}
Oct 30 14:43:00.932712 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:00.932376    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:43:00.975149 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:00.975104    4538 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66" podStartSLOduration=1.975091586 podStartE2EDuration="1.975091586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:43:00.974545535 +0000 UTC m=+2174.609492155" watchObservedRunningTime="2026-10-30 14:43:00.975091586 +0000 UTC m=+2174.610038205"
Oct 30 14:43:01.136491 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:01.136461    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhqgm_8b627267-17c9-4b45-97d7-d6fdaa731bc2/node-exporter/0.log"
Oct 30 14:43:01.258842 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:01.258772    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhqgm_8b627267-17c9-4b45-97d7-d6fdaa731bc2/kube-rbac-proxy/0.log"
Oct 30 14:43:01.381140 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:01.381113    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lhqgm_8b627267-17c9-4b45-97d7-d6fdaa731bc2/init-textfile/0.log"
Oct 30 14:43:01.618773 ip-10-0-132-7 kubenswrapper[4538]: E1030 14:43:01.618735    4538 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85889" containerName="extractor"
Oct 30 14:43:02.650843 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:02.650817    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/prometheus/0.log"
Oct 30 14:43:02.775869 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:02.775846    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/config-reloader/0.log"
Oct 30 14:43:02.900267 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:02.900222    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/thanos-sidecar/0.log"
Oct 30 14:43:03.038846 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:03.038775    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/kube-rbac-proxy-web/0.log"
Oct 30 14:43:03.161560 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:03.161535    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/kube-rbac-proxy/0.log"
Oct 30 14:43:03.284333 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:03.284306    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/kube-rbac-proxy-thanos/0.log"
Oct 30 14:43:03.408873 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:03.408850    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c48aa324-932b-4243-b07b-adf4768e1488/init-config-reloader/0.log"
Oct 30 14:43:03.781093 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:03.781023    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-95wv7_0a8d6138-c6ed-481f-93e5-dc7924b750e2/prometheus-operator-admission-webhook/0.log"
Oct 30 14:43:04.299265 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:04.299228    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd5dd96b-7chsp_91169353-ce69-4f26-8296-4e1d7aa0efcc/thanos-query/0.log"
Oct 30 14:43:04.426886 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:04.426862    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd5dd96b-7chsp_91169353-ce69-4f26-8296-4e1d7aa0efcc/kube-rbac-proxy-web/0.log"
Oct 30 14:43:04.554096 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:04.554015    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd5dd96b-7chsp_91169353-ce69-4f26-8296-4e1d7aa0efcc/kube-rbac-proxy/0.log"
Oct 30 14:43:04.702693 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:04.702669    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd5dd96b-7chsp_91169353-ce69-4f26-8296-4e1d7aa0efcc/prom-label-proxy/0.log"
Oct 30 14:43:04.844044 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:04.844017    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd5dd96b-7chsp_91169353-ce69-4f26-8296-4e1d7aa0efcc/kube-rbac-proxy-rules/0.log"
Oct 30 14:43:04.968452 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:04.968417    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd5dd96b-7chsp_91169353-ce69-4f26-8296-4e1d7aa0efcc/kube-rbac-proxy-metrics/0.log"
Oct 30 14:43:06.946277 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:06.946230    4538 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-7tl66"
Oct 30 14:43:08.904019 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:08.903994    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-hq6r9_a50d6557-45f3-486a-abbf-466c2a92b7c1/download-server/0.log"
Oct 30 14:43:12.595768 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:12.595739    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-gh9bt_e25778f1-11cd-43ed-9432-7a7aa5256d06/istio-proxy/0.log"
Oct 30 14:43:13.388957 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:13.388932    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ws6jd_67223fe5-9de3-4a9d-ad37-d7f1735bf0de/dns/0.log"
Oct 30 14:43:13.513557 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:13.513519    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ws6jd_67223fe5-9de3-4a9d-ad37-d7f1735bf0de/kube-rbac-proxy/0.log"
Oct 30 14:43:13.806601 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:13.806530    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-fkwsg_54a14e56-a813-4999-a1a3-c10fa3099a41/istio-proxy/0.log"
Oct 30 14:43:13.807632 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:13.807609    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-fkwsg_54a14e56-a813-4999-a1a3-c10fa3099a41/istio-proxy/1.log"
Oct 30 14:43:13.857950 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:13.857912    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-l2258_57985a6e-e239-4297-a32f-f7fc2283fefd/istio-proxy/0.log"
Oct 30 14:43:13.889216 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:13.889193    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4dbd_1cb64a6c-627a-4c9e-a8a9-9d2fdfead9f7/dns-node-resolver/0.log"
Oct 30 14:43:14.060622 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:14.060558    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-svls9_670c8f63-b654-485f-a6d3-85113e8114d4/istio-proxy/0.log"
Oct 30 14:43:15.046879 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:15.046848    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d9f979958-4jkmx_32b3d943-4522-4898-90cc-b4c89db038cd/registry/0.log"
Oct 30 14:43:15.185224 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:15.185198    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7r6xm_bd8815fb-55ec-4632-aa1e-aa519da33bd2/node-ca/0.log"
Oct 30 14:43:16.859101 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:16.859071    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-gh9bt_e25778f1-11cd-43ed-9432-7a7aa5256d06/istio-proxy/0.log"
Oct 30 14:43:17.478991 ip-10-0-132-7 kubenswrapper[4538]: I1030 14:43:17.478963    4538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-gh9bt_e25778f1-11cd-43ed-9432-7a7aa5256d06/istio-proxy/0.log"